Jul 10 18:30:00.485357 ip-10-0-139-156 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:30:00.969256 ip-10-0-139-156 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:30:00.969256 ip-10-0-139-156 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:30:00.969256 ip-10-0-139-156 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:30:00.969256 ip-10-0-139-156 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:30:00.969256 ip-10-0-139-156 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:30:00.969920 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.969270    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:30:00.976703 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976679    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.976703 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976698    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.976703 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976705    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976709    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976713    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976718    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976722    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976725    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976729    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976731    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976734    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976737    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976740    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976743    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976746    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976749    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976752    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976754    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976757    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976762    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976766    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976769    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.976801 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976772    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976775    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976779    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976782    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976786    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976789    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976792    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976796    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976799    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976804    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976809    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976812    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976815    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976818    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976822    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976824    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976827    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976830    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976832    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976835    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.977441 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976838    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976841    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976843    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976846    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976849    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976854    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976857    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976860    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976863    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976865    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976868    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976871    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976874    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976876    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976880    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976884    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976887    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976890    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976893    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.977996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976896    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976900    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976903    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976906    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976908    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976911    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976914    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976917    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976919    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976922    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976925    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976928    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976931    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976933    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976936    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976941    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976944    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976948    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976951    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976954    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.978516 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976956    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976959    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976962    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976965    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976968    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976971    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976974    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976977    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976980    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976983    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976986    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976989    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976992    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976995    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.976998    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977000    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977003    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977006    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977797    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977805    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.979035 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977808    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977812    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977816    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977819    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977824    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977828    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977831    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977835    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977838    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977841    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977844    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977847    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977850    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977853    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977856    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977858    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977861    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977864    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977867    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.979588 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977871    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977875    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977904    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977909    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977913    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977917    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977920    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977924    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977928    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977931    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977935    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977938    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977941    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977944    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977947    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977950    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977953    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977957    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977961    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977964    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.980079 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977967    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977970    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977973    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977976    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977978    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977981    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977984    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977987    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977990    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977993    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977995    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.977998    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978003    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978007    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978011    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978014    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978017    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978020    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978022    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978025    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.980641 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978028    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978031    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978035    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978038    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978041    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978044    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978047    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978050    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978054    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978059    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978062    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978065    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978068    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978070    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978073    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978076    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978079    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978082    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978085    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978088    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.981189 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978090    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978093    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978096    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978099    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978103    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978106    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978109    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978112    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978115    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978132    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978135    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978138    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978141    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978144    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978148    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978151    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978154    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978157    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978572    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.981696 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978577    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978581    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978583    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978586    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978589    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978592    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978595    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978598    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978601    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978604    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978607    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978609    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978612    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978615    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978617    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978620    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978623    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978627    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978630    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978633    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978636    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.982205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978638    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978641    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978644    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978647    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978649    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978652    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978656    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978659    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978661    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978664    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978667    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978670    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978673    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978675    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978678    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978681    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978686    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978690    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978694    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.982755 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978697    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978700    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978705    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978708    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978711    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978714    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978717    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978720    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978722    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978725    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978728    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978731    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978733    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978736    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978739    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978744    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978747    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978750    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978753    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.983261 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978756    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978760    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978763    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978766    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978770    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978773    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978776    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978778    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978782    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978786    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978789    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978792    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978795    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978798    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978801    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978804    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978806    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978809    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978812    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978815    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.983737 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978818    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978821    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978824    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978826    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978829    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978834    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978837    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978840    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978845    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978848    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978851    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978854    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978857    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978859    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978870    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978873    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978876    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978878    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.978881    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978959    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:30:00.984288 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978967    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978985    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978989    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978994    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.978997    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979005    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979011    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979014    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979017    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979021    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979025    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979028    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979031    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979035    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979038    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979042    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979046    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979051    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979054    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979057    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979062    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979066    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979070    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:30:00.984803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979073    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979077    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979080    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979084    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979087    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979091    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979094    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979097    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979102    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979105    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979109    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979126    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979130    2580 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979134    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979140    2580 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979144    2580 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979147    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979150    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979154    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979158    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979161    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979165    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979168    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979171    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979174    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:30:00.985414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979178    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979181    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979184    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979187    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979191    2580 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979195    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979198    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979202    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979205    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979209    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979213    2580 flags.go:64] FLAG: --help="false"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979217    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-139-156.ec2.internal"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979221    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979224    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979227    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979231    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979234    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979238    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979241    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979244    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979247    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979252    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979255    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979258    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:30:00.986060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979262    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979265    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979268    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979271    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979274    2580 flags.go:64] FLAG: --lock-file=""
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979278    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979281    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979284    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979290    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979294    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979297    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979300    2580 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979304    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979308    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979311    2580 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979315    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979319    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979323    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979327    2580 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979330    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979333    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979337    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979341    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979344    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979347    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:30:00.986723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979350    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979358    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979362    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979366    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979371    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979374    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979381    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979384    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979387    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979391    2580 flags.go:64] FLAG: --port="10250"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979394    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979398    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ded386b080726f0d"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979401    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979404    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979408    2580 flags.go:64] FLAG: --register-node="true"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979411    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979415    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979419    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979422    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979425    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979429    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979432    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979436    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979439    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979442    2580 flags.go:64] FLAG: --runonce="false"
Jul 10 18:30:00.987437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979445    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979449    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979452    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979455    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979459    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979462    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979466    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979469    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979472    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979476    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979479    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979482    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979487    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979490    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979493    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979499    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979502    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979505    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979510    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979513    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979517    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979520    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979523    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979526    2580 flags.go:64] FLAG: --v="2"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979530    2580 flags.go:64] FLAG: --version="false"
Jul 10 18:30:00.988287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979535    2580 flags.go:64] FLAG: --vmodule=""
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979541    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.979544    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979669    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979675    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979679    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979683    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979686    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979690    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979693    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979696    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979699    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979703    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979706    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979709    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979712    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979715    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979718    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979721    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979725    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.989170 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979727    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979730    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979733    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979736    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979740    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979743    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979747    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979750    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979753    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979756    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979759    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979762    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979764    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979770    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979773    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979775    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979778    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979781    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979783    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.989700 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979786    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979789    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979792    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979795    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979797    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979800    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979803    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979807    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979809    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979812    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979815    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979818    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979821    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979824    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979827    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979830    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979833    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979836    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979838    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979841    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.990277 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979844    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979847    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979850    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979853    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979856    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979859    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979863    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979866    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979869    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979872    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979875    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979877    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979880    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979883    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979886    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979888    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979891    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979894    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979897    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979900    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.990823 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979903    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979905    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979908    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979911    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979914    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979917    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979919    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979922    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979925    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979928    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979931    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979933    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979936    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979939    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979942    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979944    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979947    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979950    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979954    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979957    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.991457 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979959    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979962    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.979966    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.981044    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.989793    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.989810    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.990882    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.990904    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.990995    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991002    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991006    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991009    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991013    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991016    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.991970 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991019    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991022    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991025    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991028    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991031    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991034    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991037    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991039    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991042    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991057    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991060    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991063    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991066    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991069    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991073    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991076    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991080    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991083    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991086    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991089    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.992365 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991091    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991094    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991097    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991101    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991105    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991108    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991111    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991115    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991119    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991124    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991129    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991133    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991136    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991140    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991144    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991148    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991152    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991157    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991162    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.992869 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991166    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991170    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991173    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991177    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991181    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991184    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991187    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991190    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991195    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991199    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991202    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991205    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991207    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991210    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991213    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991216    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991221    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991225    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991228    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.993372 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991231    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991235    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991238    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991241    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991244    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991247    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991250    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991252    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991255    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991258    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991261    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991263    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991266    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991269    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991272    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991276    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991278    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991281    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991284    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991287    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.993847 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991290    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991293    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991296    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991300    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991303    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991306    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991309    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991311    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991315    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991318    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991321    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991323    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991327    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991330    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991332    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.994382 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.991338    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991470    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991476    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991480    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991484    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991487    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991490    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991493    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991496    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991500    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991502    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991505    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991508    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991512    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991515    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991517    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991520    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991523    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991526    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991530    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:30:00.994779 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991533    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991536    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991539    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991541    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991546    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991551    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991554    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991557    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991560    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991563    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991566    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991569    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991571    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991574    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991577    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991580    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991583    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991586    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991589    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991592    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:30:00.995362 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991595    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991597    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991600    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991603    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991605    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991608    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991612    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991615    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991618    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991620    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991625    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991629    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991632    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991636    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991639    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991642    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991645    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991648    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991651    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:30:00.995864 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991654    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991658    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991662    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991665    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991668    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991671    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991673    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991676    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991679    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991682    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991685    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991687    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991690    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991693    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991696    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991699    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991701    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991704    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991707    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:30:00.996403 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991710    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991713    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991716    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991719    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991724    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991727    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991730    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991732    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991735    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991738    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991741    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991744    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991747    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991749    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991752    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991755    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991758    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991761    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991763    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991766    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:30:00.996887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991769    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:30:00.997408 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:00.991772    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:30:00.997408 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.991777    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:30:00.997408 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.991907    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:30:00.997408 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.997383    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:30:00.999051 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.999038    2580 server.go:1019] "Starting client certificate rotation"
Jul 10 18:30:00.999175 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.999156    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:30:00.999209 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:00.999200    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:30:01.002614 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.002597    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:30:01.006493 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.006477    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:30:01.021277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.021256    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:30:01.024326 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.024303    2580 log.go:25] "Validated CRI v1 image API"
Jul 10 18:30:01.025324 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.025305    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:30:01.029582 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.029558    2580 fs.go:135] Filesystem UUIDs: map[3e7e3774-d53c-467b-88ff-2ae0b4b5f6c9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8846e9f2-5250-4089-a37c-84ccdf57fbc8:/dev/nvme0n1p4]
Jul 10 18:30:01.029667 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.029579    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:30:01.030677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.030655    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:30:01.037699 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.037350    2580 manager.go:216] Machine: {Timestamp:2026-07-10 18:30:01.035185908 +0000 UTC m=+0.418514159 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119080 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c8f9814e3a22fcc633e1c9831dfa SystemUUID:ec22c8f9-814e-3a22-fcc6-33e1c9831dfa BootID:a5d3da1d-8a5d-458e-966c-7be2008f66c9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:f3:63:af:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:f3:63:af:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:38:b9:26:dc:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:30:01.037699 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.037688    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:30:01.037839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.037825    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:30:01.041581 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.041554    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:30:01.041730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.041585    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:30:01.042554 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.042543    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:30:01.042588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.042557    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:30:01.042588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.042565    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:30:01.043304 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.043292    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:30:01.044218 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.044208    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:30:01.048250 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048237    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:30:01.048395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048384    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:30:01.048437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048419    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:30:01.048437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048430    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:30:01.048492 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048442    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:30:01.048492 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048452    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:30:01.048492 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048463    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:30:01.048953 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048937    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:30:01.048998 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.048963    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:30:01.051316 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.051296    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:30:01.052901 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.052885    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:30:01.052978 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.052922    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:30:01.054312 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054297    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054318    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054325    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054331    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054341    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054348    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054356    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054362    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054370    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:30:01.054375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054376    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:30:01.054612 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054386    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:30:01.054612 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.054392    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:30:01.055499 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.055485    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:30:01.055536 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.055502    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:30:01.059211 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059193    2580 server.go:1268] "Started kubelet"
Jul 10 18:30:01.059324 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.059242    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 18:30:01.059324 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059289    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 18:30:01.059420 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059307    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:30:01.059420 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.059354    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 18:30:01.059420 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059384    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:30:01.059530 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059424    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:30:01.060014 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.059975    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlf42"
Jul 10 18:30:01.060480 ip-10-0-139-156 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:30:01.060893 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.060867    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:30:01.061956 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.061943    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:30:01.065442 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.065424    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:30:01.065547 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.065436    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:30:01.065857 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.065808    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.066417 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066396    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:30:01.066417 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066401    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:30:01.066565 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066436    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:30:01.066565 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066559    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:30:01.066565 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066567    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:30:01.066978 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066958    2580 factory.go:55] Registering systemd factory
Jul 10 18:30:01.067073 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.066982    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:30:01.067487 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.067468    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlf42"
Jul 10 18:30:01.067764 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.065565    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-156.ec2.internal.18c101288b153911  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-156.ec2.internal,UID:ip-10-0-139-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-156.ec2.internal,},FirstTimestamp:2026-07-10 18:30:01.059170577 +0000 UTC m=+0.442498827,LastTimestamp:2026-07-10 18:30:01.059170577 +0000 UTC m=+0.442498827,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-156.ec2.internal,}"
Jul 10 18:30:01.068750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.068730    2580 factory.go:153] Registering CRI-O factory
Jul 10 18:30:01.068750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.068753    2580 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:30:01.068867 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.068809    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:30:01.068867 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.068853    2580 factory.go:103] Registering Raw factory
Jul 10 18:30:01.068867 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.068870    2580 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:30:01.069101 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.068963    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:30:01.069816 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.069790    2580 manager.go:349] Starting recovery of all containers
Jul 10 18:30:01.076496 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.076444    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 18:30:01.076612 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.076510    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 18:30:01.084403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.084221    2580 manager.go:354] Recovery completed
Jul 10 18:30:01.090176 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.090163    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.092162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092144    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.092256 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092183    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.092256 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092210    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.092841 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092827    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:30:01.092841 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092840    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:30:01.092963 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092856    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:30:01.092963 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.092902    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.093669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.093648    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.093755 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.093685    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.093755 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.093701    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.094168 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.094134    2580 policy_none.go:49] "None policy: Start"
Jul 10 18:30:01.094168 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.094153    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:30:01.094323 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.094177    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:30:01.094583 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.094495    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-156.ec2.internal.18c101288d0ca3ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-156.ec2.internal,UID:ip-10-0-139-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-156.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-156.ec2.internal,},FirstTimestamp:2026-07-10 18:30:01.092162541 +0000 UTC m=+0.475490792,LastTimestamp:2026-07-10 18:30:01.092162541 +0000 UTC m=+0.475490792,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-156.ec2.internal,}"
Jul 10 18:30:01.095378 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.095357    2580 policy_none.go:47] "Start"
Jul 10 18:30:01.127723 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.127706    2580 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:30:01.127820 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.127740    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:30:01.127820 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.127751    2580 server.go:87] "Starting device plugin registration server"
Jul 10 18:30:01.128056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.128042    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:30:01.128094 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.128062    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:30:01.128178 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.128142    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:30:01.128283 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.128264    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:30:01.128283 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.128280    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:30:01.128817 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.128793    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:30:01.128888 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.128845    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.229353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.229277    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.231597 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.231573    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.231679 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.231612    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.231679 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.231623    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.231679 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.231651    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.238234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.238214    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.238339 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.238243    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-156.ec2.internal\": node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.244131 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.244101    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:30:01.245488 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.245464    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:30:01.245583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.245500    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:30:01.245583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.245522    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:30:01.245583 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.245559    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:30:01.248246 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.248230    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:01.252734 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.252709    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.346563 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.346502    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"]
Jul 10 18:30:01.346753 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.346625    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.348483 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.348465    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.348595 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.348496    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.348595 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.348509    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.349980 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.349964    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.350102 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.350176 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350120    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.350742 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350723    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.350830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350754    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.350830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350769    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.350830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350731    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.350830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350824    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.350952 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.350835    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.352299 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.352279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.352397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.352322    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:30:01.352874 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.352860    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.353134 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.353099    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:30:01.353134 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.353127    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:30:01.353249 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.353139    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:30:01.368807 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.368783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.368906 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.368811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.368906 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.368831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e10b4f2e152136f6a48aa6426e23a3c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-156.ec2.internal\" (UID: \"e10b4f2e152136f6a48aa6426e23a3c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.376964 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.376938    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-156.ec2.internal\" not found" node="ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.381648 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.381627    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-156.ec2.internal\" not found" node="ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.453748 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.453696    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.469144 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.469269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.469269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e10b4f2e152136f6a48aa6426e23a3c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-156.ec2.internal\" (UID: \"e10b4f2e152136f6a48aa6426e23a3c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.469269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e10b4f2e152136f6a48aa6426e23a3c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-156.ec2.internal\" (UID: \"e10b4f2e152136f6a48aa6426e23a3c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.469269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.469269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.469231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/475deb7ae9b15cc89ba9b7b7c16fbb51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal\" (UID: \"475deb7ae9b15cc89ba9b7b7c16fbb51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.553980 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.553894    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.660498 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.660463    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.680375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.680340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.685217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.684843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:01.763985 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.763953    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.871834 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.871751    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.938979 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.938938    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:01.940647 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.940626    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:01.971887 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:01.971857    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:01.998047 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.998016    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:30:01.998196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.998174    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:30:01.998261 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.998222    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:30:01.998261 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:01.998226    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:30:02.072338 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:02.072301    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:02.077107 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.077079    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:25:01 +0000 UTC" deadline="2028-02-13 07:44:24.169576374 +0000 UTC"
Jul 10 18:30:02.077107 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.077107    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13981h14m22.092472705s"
Jul 10 18:30:02.173486 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:02.173403    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:02.274088 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:02.274055    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:02.374918 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:02.374881    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-156.ec2.internal\" not found"
Jul 10 18:30:02.461936 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.461904    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:02.467063 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.467016    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:02.475427 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.475404    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:30:02.476468 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.476449    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal"
Jul 10 18:30:02.488547 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.488526    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:30:02.537392 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:02.537363    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475deb7ae9b15cc89ba9b7b7c16fbb51.slice/crio-21452dc0c5b78da51e9b3b44b24bc9f857947cd484a9f99764a3e7b9e9ed2b15 WatchSource:0}: Error finding container 21452dc0c5b78da51e9b3b44b24bc9f857947cd484a9f99764a3e7b9e9ed2b15: Status 404 returned error can't find the container with id 21452dc0c5b78da51e9b3b44b24bc9f857947cd484a9f99764a3e7b9e9ed2b15
Jul 10 18:30:02.537604 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:02.537583    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10b4f2e152136f6a48aa6426e23a3c5.slice/crio-d11e332a2d56dde40f43457d3ea4df3c773dc0029592f0c685f4a4869d094672 WatchSource:0}: Error finding container d11e332a2d56dde40f43457d3ea4df3c773dc0029592f0c685f4a4869d094672: Status 404 returned error can't find the container with id d11e332a2d56dde40f43457d3ea4df3c773dc0029592f0c685f4a4869d094672
Jul 10 18:30:02.545516 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.545439    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:30:02.805002 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:02.804926    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:03.051958 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.051924    2580 apiserver.go:52] "Watching apiserver"
Jul 10 18:30:03.058596 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.058543    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:30:03.058940 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.058911    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-fmfcq","openshift-network-diagnostics/network-check-target-qszvn","openshift-ovn-kubernetes/ovnkube-node-krxrk","kube-system/global-pull-secret-syncer-tfxs4","openshift-dns/node-resolver-9jx6q","openshift-image-registry/node-ca-h9n9l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal","openshift-multus/multus-additional-cni-plugins-hgmnm","openshift-multus/network-metrics-daemon-tbrcg","openshift-network-operator/iptables-alerter-nbxfv","kube-system/konnectivity-agent-pt6cr","kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r","openshift-cluster-node-tuning-operator/tuned-8tv42"]
Jul 10 18:30:03.061457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.061441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.063237 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.063213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.063690 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.063664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.063774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.063726    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.063774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.063749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tg28n\""
Jul 10 18:30:03.063857 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.063827    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:30:03.064930 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.064909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.065407 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.065389    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.065548 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.065533    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.065895 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.065679    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:30:03.065895 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.065726    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:30:03.065895 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.065794    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b5rxp\""
Jul 10 18:30:03.066416 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.066398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.066501 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.066465    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:03.066836 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.066820    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.067187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.067168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.067580 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.067530    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:30:03.069222 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.068380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.069469 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.069269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x88xd\""
Jul 10 18:30:03.069535 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.069527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:30:03.069593 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.068385    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:30:03.071391 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.070778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.071391 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.071004    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:30:03.071542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.071454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmbrh\""
Jul 10 18:30:03.071907 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.071884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.071986 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.071963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.072341 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.072322    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.072442 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.072420    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:03.073060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.073020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:30:03.073060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.073023    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.073302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.073285    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmcdb\""
Jul 10 18:30:03.074207 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.074188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.074498 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.074480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.075806 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.075790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:03.075910 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.075863    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:03.075910 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.075885    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:30:03.076557 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.076539    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.076557 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.076555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vptlv\""
Jul 10 18:30:03.076673 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.076542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.077409 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.077391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.078668 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.078760 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.078760 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-config\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.078760 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3992f5eb-7054-449e-87c0-d7a51280584f-tmp-dir\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.078941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-host-slash\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.078941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-registration-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.078941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.078941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-bin\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.078941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mnk\" (UniqueName: \"kubernetes.io/projected/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kube-api-access-x6mnk\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-kubelet\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6xh\" (UniqueName: \"kubernetes.io/projected/fe72758b-ccd8-4793-ac48-4aef1735923d-kube-api-access-sc6xh\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.078990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-dbus\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-device-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-var-lib-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-etc-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe72758b-ccd8-4793-ac48-4aef1735923d-ovn-node-metrics-cert\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fccg\" (UniqueName: \"kubernetes.io/projected/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-kube-api-access-8fccg\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-socket-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-netns\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-systemd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-ovn\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-netd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-env-overrides\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-script-lib\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3992f5eb-7054-449e-87c0-d7a51280584f-hosts-file\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079486    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dzwvx\""
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079563    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-sys-fs\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-slash\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-log-socket\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-kubelet-config\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079756    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-iptables-alerter-script\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079816    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:30:03.079837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-systemd-units\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.080397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-node-log\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.080397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.080397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.079906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpblp\" (UniqueName: \"kubernetes.io/projected/3992f5eb-7054-449e-87c0-d7a51280584f-kube-api-access-gpblp\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.080397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.080309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.080677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.080660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:30:03.080734 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.080715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hdd7r\""
Jul 10 18:30:03.080848 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.080832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:30:03.082326 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.082309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:30:03.082414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.082331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kb7b\""
Jul 10 18:30:03.082625 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.082611    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:30:03.103640 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.103621    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnd9t"
Jul 10 18:30:03.112206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.112187    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnd9t"
Jul 10 18:30:03.168018 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.167993    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:30:03.180062 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-host\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180188 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-tuned\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180188 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-sys\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180188 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mnk\" (UniqueName: \"kubernetes.io/projected/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kube-api-access-x6mnk\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.180294 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-kubelet\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.180294 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b16e31c-7f91-4824-8852-8b085a778689-host\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.180375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-kubelet\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.180430 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-conf\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180430 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-system-cni-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.180537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.180537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-etc-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.180537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvcb\" (UniqueName: \"kubernetes.io/projected/19fb5293-e0d3-49e8-893a-f0810ccff543-kube-api-access-fvvcb\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.180537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-systemd\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-multus-certs\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-etc-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-socket-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysconfig\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-hostroot\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cnibin\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-os-release\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-lib-modules\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-netns\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.180741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-systemd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-ovn\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-netns\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-socket-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-script-lib\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-systemd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-ovn\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3992f5eb-7054-449e-87c0-d7a51280584f-hosts-file\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-os-release\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-run\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3992f5eb-7054-449e-87c0-d7a51280584f-hosts-file\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-slash\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-socket-dir-parent\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-slash\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.180984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-multus\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-conf-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-node-log\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpblp\" (UniqueName: \"kubernetes.io/projected/3992f5eb-7054-449e-87c0-d7a51280584f-kube-api-access-gpblp\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxzx\" (UniqueName: \"kubernetes.io/projected/6b16e31c-7f91-4824-8852-8b085a778689-kube-api-access-8pxzx\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-konnectivity-ca\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-node-log\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-modprobe-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-cni-binary-copy\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-config\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-host-slash\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-etc-kubernetes\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-host-slash\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-registration-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-agent-certs\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.181745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-tmp\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-registration-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-k8s-cni-cncf-io\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6xh\" (UniqueName: \"kubernetes.io/projected/fe72758b-ccd8-4793-ac48-4aef1735923d-kube-api-access-sc6xh\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-dbus\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbcs\" (UniqueName: \"kubernetes.io/projected/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-kube-api-access-jxbcs\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-device-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-var-lib-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe72758b-ccd8-4793-ac48-4aef1735923d-ovn-node-metrics-cert\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fccg\" (UniqueName: \"kubernetes.io/projected/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-kube-api-access-8fccg\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b16e31c-7f91-4824-8852-8b085a778689-serviceca\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-device-dir\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-kubernetes\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-var-lib-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-config\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k25x\" (UniqueName: \"kubernetes.io/projected/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-kube-api-access-4k25x\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.182564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-cnibin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-netns\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-bin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-netd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-env-overrides\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.181980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-dbus\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-netd\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-sys-fs\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.182097    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-log-socket\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182098    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-sys-fs\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-log-socket\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.182242    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:03.682217985 +0000 UTC m=+3.065546236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:03.183230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-kubelet-config\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-iptables-alerter-script\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-kubelet\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea19769-654d-4b21-b2c3-2b8731eaaf50-kubelet-config\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-ovnkube-script-lib\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe72758b-ccd8-4793-ac48-4aef1735923d-env-overrides\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-systemd-units\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-multus-daemon-config\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p97x\" (UniqueName: \"kubernetes.io/projected/12823ed2-9a25-4651-8279-efba31f2d993-kube-api-access-6p97x\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-systemd-units\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3992f5eb-7054-449e-87c0-d7a51280584f-tmp-dir\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-run-ovn-kubernetes\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-system-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.183750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-iptables-alerter-script\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-bin\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-var-lib-kubelet\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182901    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-run-openvswitch\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe72758b-ccd8-4793-ac48-4aef1735923d-host-cni-bin\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.184302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.182939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3992f5eb-7054-449e-87c0-d7a51280584f-tmp-dir\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.185452 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.185430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe72758b-ccd8-4793-ac48-4aef1735923d-ovn-node-metrics-cert\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.188746 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.188724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mnk\" (UniqueName: \"kubernetes.io/projected/8106c4af-ef9a-4f8e-8357-b56fa7c06e12-kube-api-access-x6mnk\") pod \"aws-ebs-csi-driver-node-bmw4r\" (UID: \"8106c4af-ef9a-4f8e-8357-b56fa7c06e12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.189277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.189259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6xh\" (UniqueName: \"kubernetes.io/projected/fe72758b-ccd8-4793-ac48-4aef1735923d-kube-api-access-sc6xh\") pod \"ovnkube-node-krxrk\" (UID: \"fe72758b-ccd8-4793-ac48-4aef1735923d\") " pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.189735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.189719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fccg\" (UniqueName: \"kubernetes.io/projected/1880d9bd-a0b9-4f9d-923b-19bdbbf628db-kube-api-access-8fccg\") pod \"iptables-alerter-nbxfv\" (UID: \"1880d9bd-a0b9-4f9d-923b-19bdbbf628db\") " pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.190917 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.190899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpblp\" (UniqueName: \"kubernetes.io/projected/3992f5eb-7054-449e-87c0-d7a51280584f-kube-api-access-gpblp\") pod \"node-resolver-9jx6q\" (UID: \"3992f5eb-7054-449e-87c0-d7a51280584f\") " pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.251362 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.251307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal" event={"ID":"475deb7ae9b15cc89ba9b7b7c16fbb51","Type":"ContainerStarted","Data":"21452dc0c5b78da51e9b3b44b24bc9f857947cd484a9f99764a3e7b9e9ed2b15"}
Jul 10 18:30:03.252761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.252730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal" event={"ID":"e10b4f2e152136f6a48aa6426e23a3c5","Type":"ContainerStarted","Data":"d11e332a2d56dde40f43457d3ea4df3c773dc0029592f0c685f4a4869d094672"}
Jul 10 18:30:03.283280 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-k8s-cni-cncf-io\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283280 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbcs\" (UniqueName: \"kubernetes.io/projected/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-kube-api-access-jxbcs\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b16e31c-7f91-4824-8852-8b085a778689-serviceca\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-k8s-cni-cncf-io\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-kubernetes\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k25x\" (UniqueName: \"kubernetes.io/projected/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-kube-api-access-4k25x\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-cnibin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:03.283522 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.283486    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-kubernetes\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-cnibin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.283565    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:03.783543191 +0000 UTC m=+3.166871439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-netns\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-netns\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-bin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-bin\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-kubelet\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-multus-daemon-config\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p97x\" (UniqueName: \"kubernetes.io/projected/12823ed2-9a25-4651-8279-efba31f2d993-kube-api-access-6p97x\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-system-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.283888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283887    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-kubelet\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-system-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-var-lib-kubelet\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.283925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-var-lib-kubelet\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-host\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-tuned\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-sys\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b16e31c-7f91-4824-8852-8b085a778689-host\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-conf\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-system-cni-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvcb\" (UniqueName: \"kubernetes.io/projected/19fb5293-e0d3-49e8-893a-f0810ccff543-kube-api-access-fvvcb\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-sys\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b16e31c-7f91-4824-8852-8b085a778689-serviceca\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-systemd\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-host\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.284672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysctl-conf\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b16e31c-7f91-4824-8852-8b085a778689-host\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-systemd\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-multus-certs\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-multus-daemon-config\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysconfig\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-hostroot\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-run-multus-certs\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cnibin\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-sysconfig\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-os-release\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cnibin\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-lib-modules\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-hostroot\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-os-release\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-os-release\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-system-cni-dir\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.285659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-os-release\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-run\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-socket-dir-parent\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-run\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-multus\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-lib-modules\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-socket-dir-parent\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-conf-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-host-var-lib-cni-multus\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxzx\" (UniqueName: \"kubernetes.io/projected/6b16e31c-7f91-4824-8852-8b085a778689-kube-api-access-8pxzx\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-konnectivity-ca\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-conf-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-modprobe-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-cni-binary-copy\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.284979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-etc-kubernetes\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.286497 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-agent-certs\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-modprobe-d\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-tmp\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-multus-cni-dir\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12823ed2-9a25-4651-8279-efba31f2d993-etc-kubernetes\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-konnectivity-ca\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.285649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12823ed2-9a25-4651-8279-efba31f2d993-cni-binary-copy\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.287370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.286950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-etc-tuned\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.287842 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.287476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-tmp\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.287842 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.287810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c5ef660-5cfe-4a2c-af6e-c6562d53389d-agent-certs\") pod \"konnectivity-agent-pt6cr\" (UID: \"7c5ef660-5cfe-4a2c-af6e-c6562d53389d\") " pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.289481 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.289460    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:03.289481 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.289483    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:03.289668 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.289497    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:03.289668 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.289561    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:03.789543208 +0000 UTC m=+3.172871449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:03.293215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.293191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k25x\" (UniqueName: \"kubernetes.io/projected/53fa64fd-c85d-4bb1-a7af-76676cb9ac8c-kube-api-access-4k25x\") pod \"tuned-8tv42\" (UID: \"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.293215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.293219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbcs\" (UniqueName: \"kubernetes.io/projected/b432f3ec-7e15-4e3c-9169-e4119bd4c6f2-kube-api-access-jxbcs\") pod \"multus-additional-cni-plugins-hgmnm\" (UID: \"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2\") " pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.293398 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.293282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvcb\" (UniqueName: \"kubernetes.io/projected/19fb5293-e0d3-49e8-893a-f0810ccff543-kube-api-access-fvvcb\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.293688 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.293665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p97x\" (UniqueName: \"kubernetes.io/projected/12823ed2-9a25-4651-8279-efba31f2d993-kube-api-access-6p97x\") pod \"multus-fmfcq\" (UID: \"12823ed2-9a25-4651-8279-efba31f2d993\") " pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.293759 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.293715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxzx\" (UniqueName: \"kubernetes.io/projected/6b16e31c-7f91-4824-8852-8b085a778689-kube-api-access-8pxzx\") pod \"node-ca-h9n9l\" (UID: \"6b16e31c-7f91-4824-8852-8b085a778689\") " pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.374574 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.374475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbxfv"
Jul 10 18:30:03.381914 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.381888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r"
Jul 10 18:30:03.385337 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.385305    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1880d9bd_a0b9_4f9d_923b_19bdbbf628db.slice/crio-bc445cc15df9d01774fe596e7cea88e1f9a365f4c2d778423f0e891116b3cd5d WatchSource:0}: Error finding container bc445cc15df9d01774fe596e7cea88e1f9a365f4c2d778423f0e891116b3cd5d: Status 404 returned error can't find the container with id bc445cc15df9d01774fe596e7cea88e1f9a365f4c2d778423f0e891116b3cd5d
Jul 10 18:30:03.389147 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.389114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:03.393085 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.393005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jx6q"
Jul 10 18:30:03.394972 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.394937    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8106c4af_ef9a_4f8e_8357_b56fa7c06e12.slice/crio-306763bb26315442f8312e7944b2c5bdb025488d20294d1faf7e2e34d4012ab4 WatchSource:0}: Error finding container 306763bb26315442f8312e7944b2c5bdb025488d20294d1faf7e2e34d4012ab4: Status 404 returned error can't find the container with id 306763bb26315442f8312e7944b2c5bdb025488d20294d1faf7e2e34d4012ab4
Jul 10 18:30:03.400607 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.400583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h9n9l"
Jul 10 18:30:03.404015 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.403946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe72758b_ccd8_4793_ac48_4aef1735923d.slice/crio-ff353dc25de4767d1b4d6443b6fc295697cf5574217c098ff9adbd83e8e0a117 WatchSource:0}: Error finding container ff353dc25de4767d1b4d6443b6fc295697cf5574217c098ff9adbd83e8e0a117: Status 404 returned error can't find the container with id ff353dc25de4767d1b4d6443b6fc295697cf5574217c098ff9adbd83e8e0a117
Jul 10 18:30:03.404962 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.404938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tv42"
Jul 10 18:30:03.410837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.410813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fmfcq"
Jul 10 18:30:03.411682 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.411654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3992f5eb_7054_449e_87c0_d7a51280584f.slice/crio-87383d9388e6b45f3f2f34c313625fa7d3faf9f537cb05632b63005d634381fa WatchSource:0}: Error finding container 87383d9388e6b45f3f2f34c313625fa7d3faf9f537cb05632b63005d634381fa: Status 404 returned error can't find the container with id 87383d9388e6b45f3f2f34c313625fa7d3faf9f537cb05632b63005d634381fa
Jul 10 18:30:03.412541 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.412369    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b16e31c_7f91_4824_8852_8b085a778689.slice/crio-3496bd61eba53a862fc012ebe3eaf712033b4f9c6179908621cc2544d67dbe92 WatchSource:0}: Error finding container 3496bd61eba53a862fc012ebe3eaf712033b4f9c6179908621cc2544d67dbe92: Status 404 returned error can't find the container with id 3496bd61eba53a862fc012ebe3eaf712033b4f9c6179908621cc2544d67dbe92
Jul 10 18:30:03.416948 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.416927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:03.418237 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.418182    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fa64fd_c85d_4bb1_a7af_76676cb9ac8c.slice/crio-4825df9821eaf72b12f6d349a78d48385f89ebb38a71e1590700ef69f47fd8a1 WatchSource:0}: Error finding container 4825df9821eaf72b12f6d349a78d48385f89ebb38a71e1590700ef69f47fd8a1: Status 404 returned error can't find the container with id 4825df9821eaf72b12f6d349a78d48385f89ebb38a71e1590700ef69f47fd8a1
Jul 10 18:30:03.422289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.422269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hgmnm"
Jul 10 18:30:03.422943 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.422902    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12823ed2_9a25_4651_8279_efba31f2d993.slice/crio-0368aebd0101c424b8b49036026da65bb9e6ab74dd5ae6db3ada05f162650dd5 WatchSource:0}: Error finding container 0368aebd0101c424b8b49036026da65bb9e6ab74dd5ae6db3ada05f162650dd5: Status 404 returned error can't find the container with id 0368aebd0101c424b8b49036026da65bb9e6ab74dd5ae6db3ada05f162650dd5
Jul 10 18:30:03.430668 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:03.430642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5ef660_5cfe_4a2c_af6e_c6562d53389d.slice/crio-f192dbf0dd64d06bd45769e7bc8a3339a8ef1f6c094cb4e87bab437be8fb547e WatchSource:0}: Error finding container f192dbf0dd64d06bd45769e7bc8a3339a8ef1f6c094cb4e87bab437be8fb547e: Status 404 returned error can't find the container with id f192dbf0dd64d06bd45769e7bc8a3339a8ef1f6c094cb4e87bab437be8fb547e
Jul 10 18:30:03.689630 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.689528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:03.689821 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.689698    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:03.689821 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.689767    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:04.68974751 +0000 UTC m=+4.073075748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:03.790980 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.790938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:03.791248 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.790996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:03.791248 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791207    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:03.791248 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791229    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:03.791248 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791244    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:03.791466 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791311    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:04.791287511 +0000 UTC m=+4.174615766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:03.791466 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791399    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:03.791466 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:03.791437    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:04.79142474 +0000 UTC m=+4.174752974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:03.899124 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:03.899060    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:04.059533 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.059276    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:30:04.114762 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.114695    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:25:03 +0000 UTC" deadline="2027-12-04 05:23:02.797594327 +0000 UTC"
Jul 10 18:30:04.114762 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.114756    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12274h52m58.682841389s"
Jul 10 18:30:04.246824 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.246785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:04.247021 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.246934    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:04.256267 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.256170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r" event={"ID":"8106c4af-ef9a-4f8e-8357-b56fa7c06e12","Type":"ContainerStarted","Data":"306763bb26315442f8312e7944b2c5bdb025488d20294d1faf7e2e34d4012ab4"}
Jul 10 18:30:04.258757 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.258695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbxfv" event={"ID":"1880d9bd-a0b9-4f9d-923b-19bdbbf628db","Type":"ContainerStarted","Data":"bc445cc15df9d01774fe596e7cea88e1f9a365f4c2d778423f0e891116b3cd5d"}
Jul 10 18:30:04.260637 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.260561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fmfcq" event={"ID":"12823ed2-9a25-4651-8279-efba31f2d993","Type":"ContainerStarted","Data":"0368aebd0101c424b8b49036026da65bb9e6ab74dd5ae6db3ada05f162650dd5"}
Jul 10 18:30:04.262441 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.262412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tv42" event={"ID":"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c","Type":"ContainerStarted","Data":"4825df9821eaf72b12f6d349a78d48385f89ebb38a71e1590700ef69f47fd8a1"}
Jul 10 18:30:04.264269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.264221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h9n9l" event={"ID":"6b16e31c-7f91-4824-8852-8b085a778689","Type":"ContainerStarted","Data":"3496bd61eba53a862fc012ebe3eaf712033b4f9c6179908621cc2544d67dbe92"}
Jul 10 18:30:04.265627 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.265580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jx6q" event={"ID":"3992f5eb-7054-449e-87c0-d7a51280584f","Type":"ContainerStarted","Data":"87383d9388e6b45f3f2f34c313625fa7d3faf9f537cb05632b63005d634381fa"}
Jul 10 18:30:04.267245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.267163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"ff353dc25de4767d1b4d6443b6fc295697cf5574217c098ff9adbd83e8e0a117"}
Jul 10 18:30:04.269073 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.268995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerStarted","Data":"edb35fe9794b7f011bb689eb864eea61195b4f55f3bd14c95afe9bd90acf0c6f"}
Jul 10 18:30:04.270934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.270882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt6cr" event={"ID":"7c5ef660-5cfe-4a2c-af6e-c6562d53389d","Type":"ContainerStarted","Data":"f192dbf0dd64d06bd45769e7bc8a3339a8ef1f6c094cb4e87bab437be8fb547e"}
Jul 10 18:30:04.699753 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.699394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:04.699753 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.699565    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:04.699753 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.699635    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:06.699615815 +0000 UTC m=+6.082944055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:04.800476 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.800428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:04.800664 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:04.800496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:04.800715 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800686    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:04.800715 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800707    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:04.800804 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800721    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:04.800804 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800783    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:06.800762811 +0000 UTC m=+6.184091049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:04.800926 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800895    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:04.800975 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:04.800946    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:06.800929639 +0000 UTC m=+6.184257880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:05.115994 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:05.115694    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:25:03 +0000 UTC" deadline="2028-03-14 04:37:13.754650254 +0000 UTC"
Jul 10 18:30:05.115994 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:05.115994    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14698h7m8.638662628s"
Jul 10 18:30:05.246958 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:05.246676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:05.246958 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:05.246809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:05.247343 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:05.247310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:05.247450 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:05.247431    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:06.247132 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.246494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:06.247132 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.246641    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:06.280056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.279485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal" event={"ID":"475deb7ae9b15cc89ba9b7b7c16fbb51","Type":"ContainerStarted","Data":"5fe561b8c2298a4f000cd9faa3624acaa40f72bc596046b8c7a96561ffe86592"}
Jul 10 18:30:06.282725 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.282689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal" event={"ID":"e10b4f2e152136f6a48aa6426e23a3c5","Type":"ContainerStarted","Data":"e1810d05b723788229dedd56eb3604937a554c8472e33c5449081bf658499a1c"}
Jul 10 18:30:06.312524 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.312459    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-156.ec2.internal" podStartSLOduration=3.312436778 podStartE2EDuration="3.312436778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:06.312111057 +0000 UTC m=+5.695439315" watchObservedRunningTime="2026-07-10 18:30:06.312436778 +0000 UTC m=+5.695765037"
Jul 10 18:30:06.720624 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.720526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:06.720813 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.720703    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:06.720813 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.720782    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:10.720760389 +0000 UTC m=+10.104088628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:06.821147 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.821109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:06.821353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:06.821164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:06.821353 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821329    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:06.821353 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821350    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:06.821519 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821365    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:06.821519 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:10.821406083 +0000 UTC m=+10.204734334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:06.822096 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821880    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:06.822096 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:06.821944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:10.821925668 +0000 UTC m=+10.205253925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:07.247266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:07.247233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:07.247766 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:07.247377    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:07.247960 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:07.247931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:07.248100 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:07.248077    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:08.246704 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:08.246651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:08.246911 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:08.246748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:09.246981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:09.246830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:09.247457 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:09.247028    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:09.247457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:09.247077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:09.247457 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:09.247238    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:10.246231 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.246127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:10.246400 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.246278    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:10.293913 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.293865    2580 generic.go:356] "Generic (PLEG): container finished" podID="475deb7ae9b15cc89ba9b7b7c16fbb51" containerID="5fe561b8c2298a4f000cd9faa3624acaa40f72bc596046b8c7a96561ffe86592" exitCode=0
Jul 10 18:30:10.294451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.293918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal" event={"ID":"475deb7ae9b15cc89ba9b7b7c16fbb51","Type":"ContainerDied","Data":"5fe561b8c2298a4f000cd9faa3624acaa40f72bc596046b8c7a96561ffe86592"}
Jul 10 18:30:10.756668 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.756625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:10.756864 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.756800    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:10.756913 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.756891    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.756866828 +0000 UTC m=+18.140195077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:10.857656 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.857607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:10.857836 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:10.857670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:10.857836 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857772    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:10.857957 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857847    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:10.857957 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.857839412 +0000 UTC m=+18.241167652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:10.857957 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857869    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:10.857957 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857894    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:10.857957 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:10.857950    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.857930416 +0000 UTC m=+18.241258656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:11.246904 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:11.246744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:11.246904 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:11.246870    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:11.247444 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:11.247294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:11.247444 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:11.247409    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:12.246151 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:12.246103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:12.246687 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:12.246246    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:13.245862 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:13.245832    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:13.245862 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:13.245842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:13.246123 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:13.245949    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:13.246123 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:13.246064    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:14.246335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:14.246292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:14.246805 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:14.246428    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:15.246593 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:15.246378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:15.246593 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:15.246391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:15.246593 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:15.246525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:15.247168 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:15.246620    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:15.306731 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:15.306688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal" event={"ID":"475deb7ae9b15cc89ba9b7b7c16fbb51","Type":"ContainerStarted","Data":"673ed943266b68c00e1c9ce2e4b8d7fb690c672dbf168bb0c83d14244b24721c"}
Jul 10 18:30:15.308869 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:15.308838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r" event={"ID":"8106c4af-ef9a-4f8e-8357-b56fa7c06e12","Type":"ContainerStarted","Data":"b1603e774aaa3308a2998a7d267bce1126091e2a5a7dbf35612a6c153d6a8a78"}
Jul 10 18:30:15.322072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:15.321973    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-156.ec2.internal" podStartSLOduration=12.321954594 podStartE2EDuration="12.321954594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:15.321023537 +0000 UTC m=+14.704351792" watchObservedRunningTime="2026-07-10 18:30:15.321954594 +0000 UTC m=+14.705282849"
Jul 10 18:30:16.246653 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:16.246616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:16.247138 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:16.246751    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:16.311809 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:16.311763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbxfv" event={"ID":"1880d9bd-a0b9-4f9d-923b-19bdbbf628db","Type":"ContainerStarted","Data":"5c3c5ef2f61113faeef5a715bb9a669804cb46c9a386c8644624d26839e395e3"}
Jul 10 18:30:16.326496 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:16.326444    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nbxfv" podStartSLOduration=3.006801864 podStartE2EDuration="14.326427064s" totalImagesPullingTime="11.3196252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:16.325780017 +0000 UTC m=+15.709108273" watchObservedRunningTime="2026-07-10 18:30:16.326427064 +0000 UTC m=+15.709755375"
Jul 10 18:30:17.246973 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:17.246767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:17.247452 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:17.246804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:17.247452 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:17.247071    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:17.247452 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:17.247156    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:18.246669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:18.246631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:18.246886 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.246762    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:18.826330 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:18.826292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:18.826855 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.826515    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:18.826855 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.826602    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:34.826580525 +0000 UTC m=+34.209908772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:18.927610 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:18.927518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:18.927610 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:18.927572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927703    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927747    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927762    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927771    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927788    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:34.927766401 +0000 UTC m=+34.311094645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:18.927829 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:18.927807    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:34.927796647 +0000 UTC m=+34.311124879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:19.245810 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:19.245728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:19.245810 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:19.245746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:19.246033 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:19.245869    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:19.246033 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:19.245953    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:20.246667 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:20.246627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:20.247205 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:20.246753    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:21.247018 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:21.246962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:21.247540 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:21.247123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:21.247540 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:21.247163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:21.247540 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:21.247242    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:22.246070 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:22.246016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:22.246262 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:22.246159    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:23.246521 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:23.246483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:23.246898 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:23.246483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:23.246898 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:23.246628    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:23.246898 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:23.246663    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:23.453678 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:23.453412    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:30:24.144013 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.143734    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:30:23.453669045Z","UUID":"fbd3e558-2b0a-47b2-a644-c812d22e95c4","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:30:24.145237 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.145216    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:30:24.145355 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.145253    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:30:24.246272 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.246244    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:24.246441 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:24.246353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:24.332332 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.332297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fmfcq" event={"ID":"12823ed2-9a25-4651-8279-efba31f2d993","Type":"ContainerStarted","Data":"e7bef35ae5da5c0359ac1c50a33c7ec958e1878ffa5f287f472db7e19d778bae"}
Jul 10 18:30:24.333626 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.333602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tv42" event={"ID":"53fa64fd-c85d-4bb1-a7af-76676cb9ac8c","Type":"ContainerStarted","Data":"29c244bcdf095fc85858da2e6ce4ebe15e7171e264021fbabe93670e1ff3ae97"}
Jul 10 18:30:24.335009 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.334962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h9n9l" event={"ID":"6b16e31c-7f91-4824-8852-8b085a778689","Type":"ContainerStarted","Data":"2ac268e019ec38c6f696420ec5801e75c8689589be631c35c3e8d66132e94581"}
Jul 10 18:30:24.336457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.336428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jx6q" event={"ID":"3992f5eb-7054-449e-87c0-d7a51280584f","Type":"ContainerStarted","Data":"44e1ca9789d1087b31194f8547ae887fdb530958ccbe1bdf898515ad33b8e85c"}
Jul 10 18:30:24.338850 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.338835    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:30:24.339156 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339136    2580 generic.go:356] "Generic (PLEG): container finished" podID="fe72758b-ccd8-4793-ac48-4aef1735923d" containerID="a53ca782333dc08b9f081677fd2563315db2537158dde6ed448a50e39cc98e1e" exitCode=1
Jul 10 18:30:24.339231 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"b020dcac3be7c8882ee1d40dfa7f9ed5934223ed03c8129c99dce742f7c0c580"}
Jul 10 18:30:24.339283 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"00f065d817ecab25e050510bcff49746a48efc341ceea327a36646870d08d12c"}
Jul 10 18:30:24.339329 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"87988f3457c0967ec4e720a55feffcefa1ab63e1e5bc72b0dcd4f441d53e7806"}
Jul 10 18:30:24.339370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"4780ec15afdfe60fff8da56d1fa1178a498c6011438fa9b2e9741b25380587a0"}
Jul 10 18:30:24.339370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerDied","Data":"a53ca782333dc08b9f081677fd2563315db2537158dde6ed448a50e39cc98e1e"}
Jul 10 18:30:24.339451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.339406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"8a6b0e444b43b866c44cf11b537f04a5272fb3c41c4e7ba1aa6e4cd273fa19b0"}
Jul 10 18:30:24.340586 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.340566    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="d3090ac7a3c93893edac26830f47a1b96d4cdd5a6b25e8b836a05b54d26a6485" exitCode=0
Jul 10 18:30:24.340684 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.340643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"d3090ac7a3c93893edac26830f47a1b96d4cdd5a6b25e8b836a05b54d26a6485"}
Jul 10 18:30:24.342173 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.342154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt6cr" event={"ID":"7c5ef660-5cfe-4a2c-af6e-c6562d53389d","Type":"ContainerStarted","Data":"63d5783a9ecd5d929bfa8577b91bafe1e042a4cdff364d0009a9cb3a4b777765"}
Jul 10 18:30:24.343919 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.343903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r" event={"ID":"8106c4af-ef9a-4f8e-8357-b56fa7c06e12","Type":"ContainerStarted","Data":"d8e3217c7427ba01afdd3a6863a9865cdc469969c86e4e9e0b68dc10cc3cc6fe"}
Jul 10 18:30:24.351656 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.351605    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fmfcq" podStartSLOduration=2.5246621879999998 podStartE2EDuration="22.351593474s" totalImagesPullingTime="19.826931286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:24.351110979 +0000 UTC m=+23.734439233" watchObservedRunningTime="2026-07-10 18:30:24.351593474 +0000 UTC m=+23.734921728"
Jul 10 18:30:24.371989 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.371952    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h9n9l" podStartSLOduration=11.050184436 podStartE2EDuration="22.371939392s" totalImagesPullingTime="11.321754956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:24.371614469 +0000 UTC m=+23.754942722" watchObservedRunningTime="2026-07-10 18:30:24.371939392 +0000 UTC m=+23.755267645"
Jul 10 18:30:24.409536 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.409453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pt6cr" podStartSLOduration=11.106766808 podStartE2EDuration="22.409440229s" totalImagesPullingTime="11.302673421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:24.388507117 +0000 UTC m=+23.771835371" watchObservedRunningTime="2026-07-10 18:30:24.409440229 +0000 UTC m=+23.792768538"
Jul 10 18:30:24.440445 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.440404    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8tv42" podStartSLOduration=2.610680685 podStartE2EDuration="22.440390465s" totalImagesPullingTime="19.82970978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:24.440248632 +0000 UTC m=+23.823576887" watchObservedRunningTime="2026-07-10 18:30:24.440390465 +0000 UTC m=+23.823718719"
Jul 10 18:30:24.440713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:24.440693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9jx6q" podStartSLOduration=11.114364641 podStartE2EDuration="22.4406858s" totalImagesPullingTime="11.326321159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:24.423384243 +0000 UTC m=+23.806712497" watchObservedRunningTime="2026-07-10 18:30:24.4406858 +0000 UTC m=+23.824014120"
Jul 10 18:30:25.246026 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:25.245991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:25.246306 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:25.246127    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:25.246306 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:25.246178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:25.246306 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:25.246282    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:25.349156 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:25.349113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r" event={"ID":"8106c4af-ef9a-4f8e-8357-b56fa7c06e12","Type":"ContainerStarted","Data":"71432808f56c018999547a5278e35c039b2833fbe0ef2b810e9decb37781e61e"}
Jul 10 18:30:25.371087 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:25.371021    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmw4r" podStartSLOduration=2.466710512 podStartE2EDuration="23.371007851s" totalImagesPullingTime="20.904297339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:25.370600425 +0000 UTC m=+24.753928679" watchObservedRunningTime="2026-07-10 18:30:25.371007851 +0000 UTC m=+24.754336104"
Jul 10 18:30:25.661145 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:25.661060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:26.137941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.137910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:26.138742 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.138704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:26.245778 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.245751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:26.245975 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:26.245866    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:26.355200 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.355125    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:30:26.355696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.355609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"c02d0d8b99933734e5a2f1ca436341b1cbbe1ada0d211666cef387108f552ded"}
Jul 10 18:30:26.356584 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:26.356563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pt6cr"
Jul 10 18:30:27.246286 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:27.246252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:27.246576 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:27.246252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:27.246576 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:27.246390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:27.246576 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:27.246483    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:28.245966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:28.245928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:28.246400 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:28.246063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:29.246749 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.246571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:29.247281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.246634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:29.247281 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:29.246851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:29.247281 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:29.246891    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:29.363333 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.363300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerStarted","Data":"75f1e7f72aaebf2ccac45fffc262b8af943e11d9d9751f5f3c78fc7071ccae5b"}
Jul 10 18:30:29.370370 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.370349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:30:29.370708 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.370679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"2bb14d8570df4317d7060fb299beb77f19804dd8fd0934b841c8e4e5a238c7e5"}
Jul 10 18:30:29.370952 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.370937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:29.371110 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.371097    2580 scope.go:117] "RemoveContainer" containerID="a53ca782333dc08b9f081677fd2563315db2537158dde6ed448a50e39cc98e1e"
Jul 10 18:30:29.386717 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:29.386686    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:30.246385 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.246309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:30.246551 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:30.246407    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:30.376694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.376662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:30:30.377086 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.377057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" event={"ID":"fe72758b-ccd8-4793-ac48-4aef1735923d","Type":"ContainerStarted","Data":"43f1ae464bb9280f303d2e96ff5cbf78877baf05c387d31f024fc38955e61fb5"}
Jul 10 18:30:30.377406 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.377377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:30.377499 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.377458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:30.378910 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.378888    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="75f1e7f72aaebf2ccac45fffc262b8af943e11d9d9751f5f3c78fc7071ccae5b" exitCode=0
Jul 10 18:30:30.378996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.378921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"75f1e7f72aaebf2ccac45fffc262b8af943e11d9d9751f5f3c78fc7071ccae5b"}
Jul 10 18:30:30.392978 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.392959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:30:30.406980 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:30.406937    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk" podStartSLOduration=8.472679237 podStartE2EDuration="28.406922751s" totalImagesPullingTime="19.934243514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:30.402729067 +0000 UTC m=+29.786057302" watchObservedRunningTime="2026-07-10 18:30:30.406922751 +0000 UTC m=+29.790251005"
Jul 10 18:30:31.247736 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:31.247698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:31.247910 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:31.247747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:31.247910 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:31.247826    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:31.248000 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:31.247940    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:32.246233 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:32.246197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:32.246642 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:32.246303    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:32.386587 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:32.386552    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="e6a80be4f48ef4ef8f7d8e7bef1545218d4ae86ea57abfbd9daec6ba10f85a1f" exitCode=0
Jul 10 18:30:32.386730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:32.386631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"e6a80be4f48ef4ef8f7d8e7bef1545218d4ae86ea57abfbd9daec6ba10f85a1f"}
Jul 10 18:30:33.246391 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:33.246355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:33.246737 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:33.246361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:33.246737 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:33.246468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:33.246737 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:33.246539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:34.246550 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.246514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:34.246956 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.246622    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:34.393082 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.393050    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="72e20a8f2703b8e6a8bb39af003c9859d345a229c8619f7bbe87532dd47c150b" exitCode=0
Jul 10 18:30:34.393232 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.393093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"72e20a8f2703b8e6a8bb39af003c9859d345a229c8619f7bbe87532dd47c150b"}
Jul 10 18:30:34.844706 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.844669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:34.844851 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.844812    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:34.844914 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.844870    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret podName:aea19769-654d-4b21-b2c3-2b8731eaaf50 nodeName:}" failed. No retries permitted until 2026-07-10 18:31:06.844853332 +0000 UTC m=+66.228181585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret") pod "global-pull-secret-syncer-tfxs4" (UID: "aea19769-654d-4b21-b2c3-2b8731eaaf50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:30:34.945823 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.945784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:34.945994 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:34.945835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:34.945994 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.945949    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:30:34.945994 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.945974    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:30:34.945994 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.945988    2580 projected.go:196] Error preparing data for projected volume kube-api-access-mdd6h for pod openshift-network-diagnostics/network-check-target-qszvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:34.946250 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.945947    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:34.946250 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.946035    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h podName:05098a85-c484-497a-875f-f175fea11675 nodeName:}" failed. No retries permitted until 2026-07-10 18:31:06.946023086 +0000 UTC m=+66.329351317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdd6h" (UniqueName: "kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h") pod "network-check-target-qszvn" (UID: "05098a85-c484-497a-875f-f175fea11675") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:30:34.946250 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:34.946111    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs podName:19fb5293-e0d3-49e8-893a-f0810ccff543 nodeName:}" failed. No retries permitted until 2026-07-10 18:31:06.94609901 +0000 UTC m=+66.329427246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs") pod "network-metrics-daemon-tbrcg" (UID: "19fb5293-e0d3-49e8-893a-f0810ccff543") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:30:35.246325 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:35.246231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:35.246325 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:35.246283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:35.246542 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:35.246387    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:35.246542 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:35.246517    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:36.246274 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:36.246227    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:36.246425 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:36.246353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:37.246423 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:37.246387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:37.246423 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:37.246413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:37.246955 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:37.246523    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:37.246955 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:37.246658    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:38.246403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:38.246367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:38.246579 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:38.246494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:39.246234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:39.246205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:39.246339 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:39.246248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:39.246381 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:39.246353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:39.246502 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:39.246480    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:39.407241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:39.407207    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="ed95ce2c98012d7578865d018ef46f004bcfaece3b994b677ffcbf7077353192" exitCode=0
Jul 10 18:30:39.407668 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:39.407259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"ed95ce2c98012d7578865d018ef46f004bcfaece3b994b677ffcbf7077353192"}
Jul 10 18:30:40.246632 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:40.246594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:40.246873 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:40.246695    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:40.412374 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:40.412342    2580 generic.go:356] "Generic (PLEG): container finished" podID="b432f3ec-7e15-4e3c-9169-e4119bd4c6f2" containerID="7146a8c8b1afebaef32cdd72710031c9ecb291acd63ebf09af65d56fa2099ebe" exitCode=0
Jul 10 18:30:40.412726 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:40.412390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerDied","Data":"7146a8c8b1afebaef32cdd72710031c9ecb291acd63ebf09af65d56fa2099ebe"}
Jul 10 18:30:41.247634 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:41.247443    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:41.247841 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:41.247510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:41.247841 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:41.247702    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:41.247841 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:41.247780    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:41.418419 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:41.418385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" event={"ID":"b432f3ec-7e15-4e3c-9169-e4119bd4c6f2","Type":"ContainerStarted","Data":"56634ae2b058d9734974d3e4fd84f56b2a553642a521d7c5d99899d78843d6a2"}
Jul 10 18:30:41.450974 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:41.450918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hgmnm" podStartSLOduration=16.2116762 podStartE2EDuration="39.450904267s" totalImagesPullingTime="23.239228067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:41.449446959 +0000 UTC m=+40.832775213" watchObservedRunningTime="2026-07-10 18:30:41.450904267 +0000 UTC m=+40.834232521"
Jul 10 18:30:42.246035 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:42.245997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:42.246254 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:42.246137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:43.010490 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.010456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qszvn"]
Jul 10 18:30:43.011082 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.010586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:43.011082 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:43.010694    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:43.013140 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.013110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfxs4"]
Jul 10 18:30:43.013282 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.013242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:43.013369 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:43.013345    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:43.013691 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.013660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbrcg"]
Jul 10 18:30:43.013810 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:43.013769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:43.013887 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:43.013864    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:44.246721 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:44.246636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:44.246721 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:44.246668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:44.247211 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:44.246732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:44.247211 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:44.246750    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:44.247211 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:44.246807    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:44.247211 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:44.246859    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:46.246227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.246198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:46.246732 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.246251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:46.246732 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.246264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:46.246732 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:46.246328    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfxs4" podUID="aea19769-654d-4b21-b2c3-2b8731eaaf50"
Jul 10 18:30:46.246732 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:46.246393    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbrcg" podUID="19fb5293-e0d3-49e8-893a-f0810ccff543"
Jul 10 18:30:46.246732 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:46.246483    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qszvn" podUID="05098a85-c484-497a-875f-f175fea11675"
Jul 10 18:30:46.880344 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.880316    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-156.ec2.internal" event="NodeReady"
Jul 10 18:30:46.880505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.880451    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:30:46.925313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.925281    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4w7mf"]
Jul 10 18:30:46.941644 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.941619    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7q6"]
Jul 10 18:30:46.941823 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.941803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:46.944096 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.944067    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:30:46.944229 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.944127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf98r\""
Jul 10 18:30:46.944229 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.944171    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:30:46.951535 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.951518    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4w7mf"]
Jul 10 18:30:46.951627 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.951550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7q6"]
Jul 10 18:30:46.951673 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.951632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:46.953803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.953777    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:30:46.953803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.953795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:30:46.954111 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.954093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54lkq\""
Jul 10 18:30:46.954194 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.954154    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:30:46.954194 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:46.954170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:30:47.032136 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-tmp-dir\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.032136 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hf9s\" (UniqueName: \"kubernetes.io/projected/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-kube-api-access-5hf9s\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39eadf52-2263-4b29-aa36-05d41d3ef7fc-crio-socket\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-metrics-tls\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-config-volume\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39eadf52-2263-4b29-aa36-05d41d3ef7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39eadf52-2263-4b29-aa36-05d41d3ef7fc-data-volume\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.032313 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhvgv\" (UniqueName: \"kubernetes.io/projected/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-api-access-jhvgv\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.032482 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.032327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.036116 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.036090    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j6swc"]
Jul 10 18:30:47.058365 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.058334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j6swc"]
Jul 10 18:30:47.058513 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.058444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.062081 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.062063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:30:47.062791 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.062773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ccz8c\""
Jul 10 18:30:47.063124 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.063094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:30:47.074223 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.074206    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:30:47.133018 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.132987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-tmp-dir\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hf9s\" (UniqueName: \"kubernetes.io/projected/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-kube-api-access-5hf9s\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39eadf52-2263-4b29-aa36-05d41d3ef7fc-crio-socket\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f9323ae-6984-4ace-b753-c82abf786b87-cert\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-metrics-tls\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-config-volume\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8jl\" (UniqueName: \"kubernetes.io/projected/7f9323ae-6984-4ace-b753-c82abf786b87-kube-api-access-jv8jl\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39eadf52-2263-4b29-aa36-05d41d3ef7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39eadf52-2263-4b29-aa36-05d41d3ef7fc-data-volume\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhvgv\" (UniqueName: \"kubernetes.io/projected/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-api-access-jhvgv\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39eadf52-2263-4b29-aa36-05d41d3ef7fc-crio-socket\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-tmp-dir\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39eadf52-2263-4b29-aa36-05d41d3ef7fc-data-volume\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.133828 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-config-volume\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.133889 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.133873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.137114 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.137095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-metrics-tls\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.137213 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.137117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39eadf52-2263-4b29-aa36-05d41d3ef7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.141875 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.141855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hf9s\" (UniqueName: \"kubernetes.io/projected/dec505ca-b6d6-498f-85ca-0bd47c9c0f63-kube-api-access-5hf9s\") pod \"dns-default-4w7mf\" (UID: \"dec505ca-b6d6-498f-85ca-0bd47c9c0f63\") " pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.141973 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.141911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhvgv\" (UniqueName: \"kubernetes.io/projected/39eadf52-2263-4b29-aa36-05d41d3ef7fc-kube-api-access-jhvgv\") pod \"insights-runtime-extractor-vt7q6\" (UID: \"39eadf52-2263-4b29-aa36-05d41d3ef7fc\") " pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.234098 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.234061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f9323ae-6984-4ace-b753-c82abf786b87-cert\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.234274 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.234138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8jl\" (UniqueName: \"kubernetes.io/projected/7f9323ae-6984-4ace-b753-c82abf786b87-kube-api-access-jv8jl\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.236529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.236492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f9323ae-6984-4ace-b753-c82abf786b87-cert\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.242323 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.242300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8jl\" (UniqueName: \"kubernetes.io/projected/7f9323ae-6984-4ace-b753-c82abf786b87-kube-api-access-jv8jl\") pod \"ingress-canary-j6swc\" (UID: \"7f9323ae-6984-4ace-b753-c82abf786b87\") " pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.251941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.251921    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:47.260078 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.260058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vt7q6"
Jul 10 18:30:47.367411 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.366821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j6swc"
Jul 10 18:30:47.456952 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.456781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7q6"]
Jul 10 18:30:47.460449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.460370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4w7mf"]
Jul 10 18:30:47.462205 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:47.461929    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39eadf52_2263_4b29_aa36_05d41d3ef7fc.slice/crio-c3a930873f4c6590314d94f9f17de15103f9b9f5f74c8f98c9a277bbd749828a WatchSource:0}: Error finding container c3a930873f4c6590314d94f9f17de15103f9b9f5f74c8f98c9a277bbd749828a: Status 404 returned error can't find the container with id c3a930873f4c6590314d94f9f17de15103f9b9f5f74c8f98c9a277bbd749828a
Jul 10 18:30:47.464547 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:47.464413    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec505ca_b6d6_498f_85ca_0bd47c9c0f63.slice/crio-54a142cdb6148ee65081737732914bfe5677ecaa424b22d71ba60a3a50199066 WatchSource:0}: Error finding container 54a142cdb6148ee65081737732914bfe5677ecaa424b22d71ba60a3a50199066: Status 404 returned error can't find the container with id 54a142cdb6148ee65081737732914bfe5677ecaa424b22d71ba60a3a50199066
Jul 10 18:30:47.518971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:47.518941    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j6swc"]
Jul 10 18:30:47.522542 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:47.522516    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9323ae_6984_4ace_b753_c82abf786b87.slice/crio-31ec4c16a392e93996385fb3de62eae6f74dbccb7f26e76fcdc3f7b3a965d920 WatchSource:0}: Error finding container 31ec4c16a392e93996385fb3de62eae6f74dbccb7f26e76fcdc3f7b3a965d920: Status 404 returned error can't find the container with id 31ec4c16a392e93996385fb3de62eae6f74dbccb7f26e76fcdc3f7b3a965d920
Jul 10 18:30:48.246804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.246764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:30:48.247246 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.247229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:30:48.247866 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.247521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:30:48.251839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.251238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzdtl\""
Jul 10 18:30:48.251839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.251491    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:30:48.251839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.251711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:30:48.251839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.251736    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:30:48.252364 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.251993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:30:48.262181 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.261870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hhh94\""
Jul 10 18:30:48.439469 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.439361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7q6" event={"ID":"39eadf52-2263-4b29-aa36-05d41d3ef7fc","Type":"ContainerStarted","Data":"c3a930873f4c6590314d94f9f17de15103f9b9f5f74c8f98c9a277bbd749828a"}
Jul 10 18:30:48.441424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.441391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w7mf" event={"ID":"dec505ca-b6d6-498f-85ca-0bd47c9c0f63","Type":"ContainerStarted","Data":"54a142cdb6148ee65081737732914bfe5677ecaa424b22d71ba60a3a50199066"}
Jul 10 18:30:48.443362 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:48.443335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j6swc" event={"ID":"7f9323ae-6984-4ace-b753-c82abf786b87","Type":"ContainerStarted","Data":"31ec4c16a392e93996385fb3de62eae6f74dbccb7f26e76fcdc3f7b3a965d920"}
Jul 10 18:30:49.724995 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.724958    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gplk5"]
Jul 10 18:30:49.736935 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.736908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gplk5"]
Jul 10 18:30:49.737081 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.737058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.739353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.739327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 18:30:49.740315 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.739999    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dvmmk\""
Jul 10 18:30:49.740315 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.740063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 18:30:49.740315 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.740111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:30:49.740315 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.740312    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 18:30:49.740596 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.740340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:30:49.747493 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.747467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.747607 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.747517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8rjd\" (UniqueName: \"kubernetes.io/projected/fc245db1-f00b-40a2-8f13-1092607c45c6-kube-api-access-h8rjd\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.747607 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.747559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.747698 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.747616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc245db1-f00b-40a2-8f13-1092607c45c6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.848903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.848646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.848903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.848716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8rjd\" (UniqueName: \"kubernetes.io/projected/fc245db1-f00b-40a2-8f13-1092607c45c6-kube-api-access-h8rjd\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.848903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.848758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.848903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.848795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc245db1-f00b-40a2-8f13-1092607c45c6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.849510 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:49.849414    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 18:30:49.849510 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:49.849499    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls podName:fc245db1-f00b-40a2-8f13-1092607c45c6 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:50.349477552 +0000 UTC m=+49.732805802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls") pod "prometheus-operator-64785b6675-gplk5" (UID: "fc245db1-f00b-40a2-8f13-1092607c45c6") : secret "prometheus-operator-tls" not found
Jul 10 18:30:49.849675 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.849639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc245db1-f00b-40a2-8f13-1092607c45c6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.854289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.854262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:49.858788 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:49.858739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8rjd\" (UniqueName: \"kubernetes.io/projected/fc245db1-f00b-40a2-8f13-1092607c45c6-kube-api-access-h8rjd\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:50.352610 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:50.352579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:50.352798 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:50.352748    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 18:30:50.352850 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:50.352817    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls podName:fc245db1-f00b-40a2-8f13-1092607c45c6 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:51.352798138 +0000 UTC m=+50.736126371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls") pod "prometheus-operator-64785b6675-gplk5" (UID: "fc245db1-f00b-40a2-8f13-1092607c45c6") : secret "prometheus-operator-tls" not found
Jul 10 18:30:51.360502 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:51.360470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:51.366135 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:51.363328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc245db1-f00b-40a2-8f13-1092607c45c6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gplk5\" (UID: \"fc245db1-f00b-40a2-8f13-1092607c45c6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:51.548420 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:51.548375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5"
Jul 10 18:30:53.539099 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:53.539070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gplk5"]
Jul 10 18:30:53.542239 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:53.542211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc245db1_f00b_40a2_8f13_1092607c45c6.slice/crio-e7a8fa9ed07f15b790f3fe27834c3a084426be81f1f4ae9626d745e8215776ff WatchSource:0}: Error finding container e7a8fa9ed07f15b790f3fe27834c3a084426be81f1f4ae9626d745e8215776ff: Status 404 returned error can't find the container with id e7a8fa9ed07f15b790f3fe27834c3a084426be81f1f4ae9626d745e8215776ff
Jul 10 18:30:54.463715 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.463434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j6swc" event={"ID":"7f9323ae-6984-4ace-b753-c82abf786b87","Type":"ContainerStarted","Data":"03a33170fc18d711161d71d4b6dcbc0d8e5fbae47e7e3073da2b4e7dee3e3191"}
Jul 10 18:30:54.465216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.465185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7q6" event={"ID":"39eadf52-2263-4b29-aa36-05d41d3ef7fc","Type":"ContainerStarted","Data":"280b4a9351d98dbd88d31b8c2083e58e89308b19f3618fac6cb488306bf35423"}
Jul 10 18:30:54.467178 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.467147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w7mf" event={"ID":"dec505ca-b6d6-498f-85ca-0bd47c9c0f63","Type":"ContainerStarted","Data":"4f2c419b62caa0e2a9f92e5104fa5d7f1e1b4af18a7b49b6cf3d6824c1024a65"}
Jul 10 18:30:54.467326 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.467199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w7mf" event={"ID":"dec505ca-b6d6-498f-85ca-0bd47c9c0f63","Type":"ContainerStarted","Data":"93d964268b42a9e3897d1f4c808f89391f1a03342b907b72fe9bbd70632c44e1"}
Jul 10 18:30:54.467326 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.467232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:30:54.468539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.468516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5" event={"ID":"fc245db1-f00b-40a2-8f13-1092607c45c6","Type":"ContainerStarted","Data":"e7a8fa9ed07f15b790f3fe27834c3a084426be81f1f4ae9626d745e8215776ff"}
Jul 10 18:30:54.479804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.479743    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j6swc" podStartSLOduration=1.588607487 podStartE2EDuration="7.479726267s" totalImagesPullingTime="5.89111878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:54.479301443 +0000 UTC m=+53.862629711" watchObservedRunningTime="2026-07-10 18:30:54.479726267 +0000 UTC m=+53.863054521"
Jul 10 18:30:54.497732 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:54.497672    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4w7mf" podStartSLOduration=2.557874725 podStartE2EDuration="8.497650385s" totalImagesPullingTime="5.93977566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:54.496273898 +0000 UTC m=+53.879602151" watchObservedRunningTime="2026-07-10 18:30:54.497650385 +0000 UTC m=+53.880978640"
Jul 10 18:30:55.480840 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:55.480746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7q6" event={"ID":"39eadf52-2263-4b29-aa36-05d41d3ef7fc","Type":"ContainerStarted","Data":"296212321c9ca5c96896f49c5c5500e5ed81cec8f53c2be4c2d0bec7d3208012"}
Jul 10 18:30:55.483030 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:55.482996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5" event={"ID":"fc245db1-f00b-40a2-8f13-1092607c45c6","Type":"ContainerStarted","Data":"a209afe0565f4707d536c248d767dc9644b9c8e53addd28aa1f266ed56102e87"}
Jul 10 18:30:55.483185 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:55.483090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5" event={"ID":"fc245db1-f00b-40a2-8f13-1092607c45c6","Type":"ContainerStarted","Data":"56f48d70a70ee1a6dcc4c906952e2cfcd91aaa4ac00301bf2b5054534206b045"}
Jul 10 18:30:55.500419 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:55.500362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-gplk5" podStartSLOduration=4.821116904 podStartE2EDuration="6.500344072s" totalImagesPullingTime="1.679227168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:55.500093404 +0000 UTC m=+54.883421659" watchObservedRunningTime="2026-07-10 18:30:55.500344072 +0000 UTC m=+54.883672322"
Jul 10 18:30:56.252244 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.252211    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:30:56.254081 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.254059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.256557 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.256535    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 18:30:56.256665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.256623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 18:30:56.257300 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.257281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9kk5z\""
Jul 10 18:30:56.257363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.257320    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 18:30:56.257670 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.257647    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 18:30:56.257769 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.257700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 18:30:56.257941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.257925    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 18:30:56.258088 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.258069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 18:30:56.261972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.261948    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 18:30:56.266933 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.266874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:30:56.305695 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.305871 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.305871 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.305871 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.306053 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.306053 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfz8t\" (UniqueName: \"kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.306053 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.305945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfz8t\" (UniqueName: \"kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407500 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.407888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.407860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.408144 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.408117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.408458 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.408421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.408557 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.408539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.411542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.411521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.411624 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.411529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.415363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.415343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfz8t\" (UniqueName: \"kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t\") pod \"console-f94c6cb67-6gc4v\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") " pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.566266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.566228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:30:56.712787 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:56.712752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:30:56.717433 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:56.717210    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7d792f_7f5d_468b_84ce_2d2e933d54d7.slice/crio-94cbd1638c4a5acf1ce3dcb76b0eb6d7f61983bb967979ae316d774a0ad6d230 WatchSource:0}: Error finding container 94cbd1638c4a5acf1ce3dcb76b0eb6d7f61983bb967979ae316d774a0ad6d230: Status 404 returned error can't find the container with id 94cbd1638c4a5acf1ce3dcb76b0eb6d7f61983bb967979ae316d774a0ad6d230
Jul 10 18:30:57.053376 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.053343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"]
Jul 10 18:30:57.056355 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.056327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.058452 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.058430    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4zkgx\""
Jul 10 18:30:57.058811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.058790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 18:30:57.059134 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.059117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:30:57.070876 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.070851    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"]
Jul 10 18:30:57.073967 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.073605    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rwkng"]
Jul 10 18:30:57.076473 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.076450    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"]
Jul 10 18:30:57.076617 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.076596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.081011 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.080208    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 18:30:57.081011 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.080551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 18:30:57.081011 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.080756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cvltk\""
Jul 10 18:30:57.081011 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.080993    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 18:30:57.082931 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.082909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.085014 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.084995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 18:30:57.085444 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.085423    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:30:57.085735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.085652    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rpbm7\""
Jul 10 18:30:57.086187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.086166    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 18:30:57.092340 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.092316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"]
Jul 10 18:30:57.113708 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.113843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppg5\" (UniqueName: \"kubernetes.io/projected/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-kube-api-access-lppg5\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.113843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.113843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.113843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-textfile\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.113843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k252k\" (UniqueName: \"kubernetes.io/projected/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-api-access-k252k\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.114065 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.114065 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114065 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.113985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114065 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-sys\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrk72\" (UniqueName: \"kubernetes.io/projected/9159a9c3-4ec6-45e4-84f0-e149418ca497-kube-api-access-lrk72\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-metrics-client-ca\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.114241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.114425 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-wtmp\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.114425 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/68d8dee9-eee8-4286-95e1-ef77cd05fad8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.114425 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.114425 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.114336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-root\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.215571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.215571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-wtmp\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/68d8dee9-eee8-4286-95e1-ef77cd05fad8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-root\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.215755    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-wtmp\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.215834 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.215839    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls podName:b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa nodeName:}" failed. No retries permitted until 2026-07-10 18:30:57.715818267 +0000 UTC m=+57.099146502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-jvgqf" (UID: "b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa") : secret "openshift-state-metrics-tls" not found
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-root\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppg5\" (UniqueName: \"kubernetes.io/projected/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-kube-api-access-lppg5\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.215990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-textfile\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k252k\" (UniqueName: \"kubernetes.io/projected/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-api-access-k252k\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-sys\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrk72\" (UniqueName: \"kubernetes.io/projected/9159a9c3-4ec6-45e4-84f0-e149418ca497-kube-api-access-lrk72\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216748 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-metrics-client-ca\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216748 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/68d8dee9-eee8-4286-95e1-ef77cd05fad8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.216748 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.216416    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 10 18:30:57.216748 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.216487    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 18:30:57.216748 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.216954 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-textfile\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216954 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.216492    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls podName:68d8dee9-eee8-4286-95e1-ef77cd05fad8 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:57.716469917 +0000 UTC m=+57.099798163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-x6d8j" (UID: "68d8dee9-eee8-4286-95e1-ef77cd05fad8") : secret "kube-state-metrics-tls" not found
Jul 10 18:30:57.216954 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:57.216843    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls podName:9159a9c3-4ec6-45e4-84f0-e149418ca497 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:57.716827469 +0000 UTC m=+57.100155711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls") pod "node-exporter-rwkng" (UID: "9159a9c3-4ec6-45e4-84f0-e149418ca497") : secret "node-exporter-tls" not found
Jul 10 18:30:57.216954 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-metrics-client-ca\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.216954 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.216949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9159a9c3-4ec6-45e4-84f0-e149418ca497-sys\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.217226 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.217203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.217408 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.217382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.217755 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.217728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d8dee9-eee8-4286-95e1-ef77cd05fad8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.219473 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.219446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.219605 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.219551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.219655 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.219615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.226966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.226943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrk72\" (UniqueName: \"kubernetes.io/projected/9159a9c3-4ec6-45e4-84f0-e149418ca497-kube-api-access-lrk72\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.227242 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.227196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppg5\" (UniqueName: \"kubernetes.io/projected/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-kube-api-access-lppg5\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.227390 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.227369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k252k\" (UniqueName: \"kubernetes.io/projected/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-api-access-k252k\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.492017 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.491931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f94c6cb67-6gc4v" event={"ID":"bc7d792f-7f5d-468b-84ce-2d2e933d54d7","Type":"ContainerStarted","Data":"94cbd1638c4a5acf1ce3dcb76b0eb6d7f61983bb967979ae316d774a0ad6d230"}
Jul 10 18:30:57.721094 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.721055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.721583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.721121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.721583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.721195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.724195 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.724171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d8dee9-eee8-4286-95e1-ef77cd05fad8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-x6d8j\" (UID: \"68d8dee9-eee8-4286-95e1-ef77cd05fad8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:57.724319 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.724171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9159a9c3-4ec6-45e4-84f0-e149418ca497-node-exporter-tls\") pod \"node-exporter-rwkng\" (UID: \"9159a9c3-4ec6-45e4-84f0-e149418ca497\") " pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.724875 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.724855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jvgqf\" (UID: \"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.967540 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.967517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"
Jul 10 18:30:57.992830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.992805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwkng"
Jul 10 18:30:57.998781 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:57.998753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"
Jul 10 18:30:58.003971 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:58.003943    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9159a9c3_4ec6_45e4_84f0_e149418ca497.slice/crio-0104436b965676cde3aed2d6c6b2b7700ebfa2eaa03fbfeb8df1b55bab53a009 WatchSource:0}: Error finding container 0104436b965676cde3aed2d6c6b2b7700ebfa2eaa03fbfeb8df1b55bab53a009: Status 404 returned error can't find the container with id 0104436b965676cde3aed2d6c6b2b7700ebfa2eaa03fbfeb8df1b55bab53a009
Jul 10 18:30:58.114152 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.113001    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf"]
Jul 10 18:30:58.159585 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.159560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:30:58.163084 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.163063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.165479 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.165301    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.165675    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.165916    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166020    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166208    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dxfq7\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 18:30:58.166403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.165917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 18:30:58.166975 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.166955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-x6d8j"]
Jul 10 18:30:58.167212 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.167195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 18:30:58.171322 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:30:58.171286    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d8dee9_eee8_4286_95e1_ef77cd05fad8.slice/crio-59a37648821a6a59f047b9f379e0baf9858ef70b022676a524f8565581a90d89 WatchSource:0}: Error finding container 59a37648821a6a59f047b9f379e0baf9858ef70b022676a524f8565581a90d89: Status 404 returned error can't find the container with id 59a37648821a6a59f047b9f379e0baf9858ef70b022676a524f8565581a90d89
Jul 10 18:30:58.179887 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.179867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:30:58.227144 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227144 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227144 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfvm\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.227622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.227591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328087 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328379 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:58.328314    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle podName:e926329a-edd9-4cd1-bcde-8532ee7b8239 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:58.828289904 +0000 UTC m=+58.211618153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239") : configmap references non-existent config key: ca-bundle.crt
Jul 10 18:30:58.328429 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328474 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328524 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328614 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:58.328595    2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 10 18:30:58.328673 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:30:58.328662    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls podName:e926329a-edd9-4cd1-bcde-8532ee7b8239 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:58.82864374 +0000 UTC m=+58.211971984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239") : secret "alertmanager-main-tls" not found
Jul 10 18:30:58.328673 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfvm\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.328966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.328939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.329276 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.329249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.329632 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.329603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.331729 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.331708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.331920 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.331899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.332424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.332355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.332669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.332612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.332669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.332613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.332669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.332645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.333170 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.333147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.333941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.333918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.338225 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.338205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfvm\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.499429 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.499275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf" event={"ID":"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa","Type":"ContainerStarted","Data":"4bddab6bdb2fde0e56b03647eca95fee46bb2f13498bb316ea1c862afc31f3c8"}
Jul 10 18:30:58.499429 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.499390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf" event={"ID":"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa","Type":"ContainerStarted","Data":"0f547e69515bb42f3d16e7261578c2f09b8bf11a55bfcab2b74fd30d227d682b"}
Jul 10 18:30:58.499429 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.499419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf" event={"ID":"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa","Type":"ContainerStarted","Data":"36316de9d5a93548e9f91e2af311b5f6d2ebb27fe02f828db8d716c88da1e04f"}
Jul 10 18:30:58.500932 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.500905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j" event={"ID":"68d8dee9-eee8-4286-95e1-ef77cd05fad8","Type":"ContainerStarted","Data":"59a37648821a6a59f047b9f379e0baf9858ef70b022676a524f8565581a90d89"}
Jul 10 18:30:58.502682 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.502655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwkng" event={"ID":"9159a9c3-4ec6-45e4-84f0-e149418ca497","Type":"ContainerStarted","Data":"0104436b965676cde3aed2d6c6b2b7700ebfa2eaa03fbfeb8df1b55bab53a009"}
Jul 10 18:30:58.506414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.506352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7q6" event={"ID":"39eadf52-2263-4b29-aa36-05d41d3ef7fc","Type":"ContainerStarted","Data":"617bdf21e2e2cd96837311e9302e6344b61605ad60a34217901a48d20506d9bb"}
Jul 10 18:30:58.524981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.524918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vt7q6" podStartSLOduration=2.234674707 podStartE2EDuration="12.524899246s" totalImagesPullingTime="10.290224539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:58.522396592 +0000 UTC m=+57.905724849" watchObservedRunningTime="2026-07-10 18:30:58.524899246 +0000 UTC m=+57.908227501"
Jul 10 18:30:58.834741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.834681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.834741 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.834742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.835996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.835965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:58.837918 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:58.837869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:59.075739 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:59.075697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:30:59.529068 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:59.529015    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j" event={"ID":"68d8dee9-eee8-4286-95e1-ef77cd05fad8","Type":"ContainerStarted","Data":"f04f8ad3160730ebbc203c00d24d65a9d19a6c3d81509bf4bd58010753864b3b"}
Jul 10 18:30:59.535229 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:59.535149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwkng" event={"ID":"9159a9c3-4ec6-45e4-84f0-e149418ca497","Type":"ContainerStarted","Data":"c7fd5050444d8900dc5ed387f3567e8051d177fdcde5468398fc9f27a5ea6433"}
Jul 10 18:30:59.580823 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:30:59.580669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:31:00.046809 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.046775    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74547b45-4c8n7"]
Jul 10 18:31:00.052694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.052640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.055411 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055385    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 18:31:00.055553 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 18:31:00.055553 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055461    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 18:31:00.055553 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055485    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-plnpp\""
Jul 10 18:31:00.055553 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 18:31:00.055553 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 18:31:00.055794 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.055610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1r91um70ov81b\""
Jul 10 18:31:00.063132 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.063110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74547b45-4c8n7"]
Jul 10 18:31:00.149528 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sdb\" (UniqueName: \"kubernetes.io/projected/f9840015-a21f-4f1f-b994-2319233e1c14-kube-api-access-b8sdb\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-grpc-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9840015-a21f-4f1f-b994-2319233e1c14-metrics-client-ca\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.149928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.149842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251103 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9840015-a21f-4f1f-b994-2319233e1c14-metrics-client-ca\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sdb\" (UniqueName: \"kubernetes.io/projected/f9840015-a21f-4f1f-b994-2319233e1c14-kube-api-access-b8sdb\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251546 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.251546 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.251358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-grpc-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.252648 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.252588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9840015-a21f-4f1f-b994-2319233e1c14-metrics-client-ca\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.254306 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.254257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.254421 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.254365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-grpc-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.254722 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.254670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.255004 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.254978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.255591 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.255564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-tls\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.255700 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.255666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f9840015-a21f-4f1f-b994-2319233e1c14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.261133 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.261110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sdb\" (UniqueName: \"kubernetes.io/projected/f9840015-a21f-4f1f-b994-2319233e1c14-kube-api-access-b8sdb\") pod \"thanos-querier-74547b45-4c8n7\" (UID: \"f9840015-a21f-4f1f-b994-2319233e1c14\") " pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.364285 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.364195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:00.541102 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.541056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j" event={"ID":"68d8dee9-eee8-4286-95e1-ef77cd05fad8","Type":"ContainerStarted","Data":"78e7bbe4432ba898938c71d558ce5b177372e1a192d76f8b684e26b929aa300a"}
Jul 10 18:31:00.541281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.541136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j" event={"ID":"68d8dee9-eee8-4286-95e1-ef77cd05fad8","Type":"ContainerStarted","Data":"c525602a05be17f5ca8d449bb372faab29424b3320847079ea99b27e26e4f421"}
Jul 10 18:31:00.542939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.542816    2580 generic.go:356] "Generic (PLEG): container finished" podID="9159a9c3-4ec6-45e4-84f0-e149418ca497" containerID="c7fd5050444d8900dc5ed387f3567e8051d177fdcde5468398fc9f27a5ea6433" exitCode=0
Jul 10 18:31:00.542939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.542926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwkng" event={"ID":"9159a9c3-4ec6-45e4-84f0-e149418ca497","Type":"ContainerDied","Data":"c7fd5050444d8900dc5ed387f3567e8051d177fdcde5468398fc9f27a5ea6433"}
Jul 10 18:31:00.544774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.544738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"d1fb875f5d0d9744cbd75803e56a2779f6c32cb917ceef0c0c02067104e43ce1"}
Jul 10 18:31:00.558648 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:00.558596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-x6d8j" podStartSLOduration=2.325851 podStartE2EDuration="3.558582146s" totalImagesPullingTime="1.232731146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:00.557366079 +0000 UTC m=+59.940694336" watchObservedRunningTime="2026-07-10 18:31:00.558582146 +0000 UTC m=+59.941910400"
Jul 10 18:31:01.197056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.197017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74547b45-4c8n7"]
Jul 10 18:31:01.199602 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:01.199574    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9840015_a21f_4f1f_b994_2319233e1c14.slice/crio-2555318e4914885dc8c2d49d8cd5eedcbb87e5396589beabaca775d81c7c2bdb WatchSource:0}: Error finding container 2555318e4914885dc8c2d49d8cd5eedcbb87e5396589beabaca775d81c7c2bdb: Status 404 returned error can't find the container with id 2555318e4914885dc8c2d49d8cd5eedcbb87e5396589beabaca775d81c7c2bdb
Jul 10 18:31:01.362710 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.362678    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f88d87764-mlf6d"]
Jul 10 18:31:01.381054 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.381006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f88d87764-mlf6d"]
Jul 10 18:31:01.381198 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.381143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.383897 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.383690    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 18:31:01.383897 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.383738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 18:31:01.383897 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.383818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7gt44ocutbk9r\""
Jul 10 18:31:01.384264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.383948    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 18:31:01.384264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.384067    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 18:31:01.384355 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.384330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zmrjv\""
Jul 10 18:31:01.462124 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-tls\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrh7r\" (UniqueName: \"kubernetes.io/projected/89308245-46b2-405f-a114-6bef55e6e38d-kube-api-access-xrh7r\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-client-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-metrics-server-audit-profiles\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-client-certs\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.462457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.462380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89308245-46b2-405f-a114-6bef55e6e38d-audit-log\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.552070 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.552014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwkng" event={"ID":"9159a9c3-4ec6-45e4-84f0-e149418ca497","Type":"ContainerStarted","Data":"1d65d6e7f3de91a41b3b2c566d07ae4968f1df5a576db351c109bb2781b1847e"}
Jul 10 18:31:01.552238 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.552102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwkng" event={"ID":"9159a9c3-4ec6-45e4-84f0-e149418ca497","Type":"ContainerStarted","Data":"295191ff94134d68ef79997d9f0df69673db69b4948e03004309f549c7cbdfb1"}
Jul 10 18:31:01.553970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.553927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f94c6cb67-6gc4v" event={"ID":"bc7d792f-7f5d-468b-84ce-2d2e933d54d7","Type":"ContainerStarted","Data":"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"}
Jul 10 18:31:01.555335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.555305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"2555318e4914885dc8c2d49d8cd5eedcbb87e5396589beabaca775d81c7c2bdb"}
Jul 10 18:31:01.557711 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.557685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf" event={"ID":"b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa","Type":"ContainerStarted","Data":"83547ef56c9778ca08ec56b93b10161453062101638dbfa6549de098749b66f4"}
Jul 10 18:31:01.563483 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-client-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563592 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-metrics-server-audit-profiles\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563592 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-client-certs\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563781 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89308245-46b2-405f-a114-6bef55e6e38d-audit-log\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563781 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563781 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-tls\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.563781 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.563735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrh7r\" (UniqueName: \"kubernetes.io/projected/89308245-46b2-405f-a114-6bef55e6e38d-kube-api-access-xrh7r\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.564294 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.564266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89308245-46b2-405f-a114-6bef55e6e38d-audit-log\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.564508 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.564488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.565214 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.565192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89308245-46b2-405f-a114-6bef55e6e38d-metrics-server-audit-profiles\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.566560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.566537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-tls\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.566663 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.566541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-client-ca-bundle\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.566663 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.566626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89308245-46b2-405f-a114-6bef55e6e38d-secret-metrics-server-client-certs\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.569394 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.569336    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rwkng" podStartSLOduration=3.054458794 podStartE2EDuration="4.56932361s" totalImagesPullingTime="1.397197146s" totalInitContainerRuntime="117.66767ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:01.569002542 +0000 UTC m=+60.952330798" watchObservedRunningTime="2026-07-10 18:31:01.56932361 +0000 UTC m=+60.952651864"
Jul 10 18:31:01.574115 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.574093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrh7r\" (UniqueName: \"kubernetes.io/projected/89308245-46b2-405f-a114-6bef55e6e38d-kube-api-access-xrh7r\") pod \"metrics-server-f88d87764-mlf6d\" (UID: \"89308245-46b2-405f-a114-6bef55e6e38d\") " pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.603986 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.603927    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jvgqf" podStartSLOduration=1.8126085060000001 podStartE2EDuration="4.603907396s" totalImagesPullingTime="2.79129889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:01.584960658 +0000 UTC m=+60.968288913" watchObservedRunningTime="2026-07-10 18:31:01.603907396 +0000 UTC m=+60.987235647"
Jul 10 18:31:01.604503 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.604477    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f94c6cb67-6gc4v" podStartSLOduration=1.28601569 podStartE2EDuration="5.604467492s" totalImagesPullingTime="4.318451802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:01.603613112 +0000 UTC m=+60.986941365" watchObservedRunningTime="2026-07-10 18:31:01.604467492 +0000 UTC m=+60.987795745"
Jul 10 18:31:01.691194 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.691108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:01.827332 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.827300    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f88d87764-mlf6d"]
Jul 10 18:31:01.830776 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:01.830737    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89308245_46b2_405f_a114_6bef55e6e38d.slice/crio-64ca1776ecf751678df0dde65e90fce2c5751f36040d156e752623b727012b5d WatchSource:0}: Error finding container 64ca1776ecf751678df0dde65e90fce2c5751f36040d156e752623b727012b5d: Status 404 returned error can't find the container with id 64ca1776ecf751678df0dde65e90fce2c5751f36040d156e752623b727012b5d
Jul 10 18:31:01.861251 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.861229    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"]
Jul 10 18:31:01.876896 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.876860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"]
Jul 10 18:31:01.877026 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.876966    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:01.879314 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.879287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5shpj\""
Jul 10 18:31:01.879424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.879343    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 18:31:01.969862 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.968960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l999s\" (UniqueName: \"kubernetes.io/projected/cad69796-7ca8-4c98-8c11-4bb681878fab-kube-api-access-l999s\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:01.969862 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:01.969098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cad69796-7ca8-4c98-8c11-4bb681878fab-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.069759 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.069715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cad69796-7ca8-4c98-8c11-4bb681878fab-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.069943 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.069839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l999s\" (UniqueName: \"kubernetes.io/projected/cad69796-7ca8-4c98-8c11-4bb681878fab-kube-api-access-l999s\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.070505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.070476    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:02.072821 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.072795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cad69796-7ca8-4c98-8c11-4bb681878fab-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.086745 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.086694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l999s\" (UniqueName: \"kubernetes.io/projected/cad69796-7ca8-4c98-8c11-4bb681878fab-kube-api-access-l999s\") pod \"monitoring-plugin-5f68df7f58-kpsxq\" (UID: \"cad69796-7ca8-4c98-8c11-4bb681878fab\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.089257 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.089220    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:02.089389 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.089330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171352 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdlb\" (UniqueName: \"kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171727 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.171727 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.171586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.204715 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.204640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdlb\" (UniqueName: \"kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.272934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.272606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276307 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.274723    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"]
Jul 10 18:31:02.276307 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.274867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276307 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.274915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.276505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276666 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.276635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276912 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.276891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.276982 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.276946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.283079 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.283033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdlb\" (UniqueName: \"kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb\") pod \"console-7c6dcf985f-lblm6\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") " pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.295550 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.295526    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"]
Jul 10 18:31:02.295693 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.295672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.297953 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.297927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 18:31:02.298117 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.297965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 18:31:02.298117 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.298012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 18:31:02.298117 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.297964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 18:31:02.298258 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.297964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 18:31:02.298333 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.298316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c9rjd\""
Jul 10 18:31:02.303472 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.303447    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 18:31:02.353526 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.353494    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"]
Jul 10 18:31:02.356011 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:02.355984    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad69796_7ca8_4c98_8c11_4bb681878fab.slice/crio-5c0da4e2c3916eed07eb344dbd8cc34845967e6dbcbf388fafc665e2f25b9d36 WatchSource:0}: Error finding container 5c0da4e2c3916eed07eb344dbd8cc34845967e6dbcbf388fafc665e2f25b9d36: Status 404 returned error can't find the container with id 5c0da4e2c3916eed07eb344dbd8cc34845967e6dbcbf388fafc665e2f25b9d36
Jul 10 18:31:02.373305 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6wz7\" (UniqueName: \"kubernetes.io/projected/9551c57c-f5ba-4909-9ee6-8cc91be51963-kube-api-access-s6wz7\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373558 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-federate-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373558 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373558 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-metrics-client-ca\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-serving-certs-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.373713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.373620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.400870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.400841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:02.403875 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.403849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krxrk"
Jul 10 18:31:02.474118 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474267 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6wz7\" (UniqueName: \"kubernetes.io/projected/9551c57c-f5ba-4909-9ee6-8cc91be51963-kube-api-access-s6wz7\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474267 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-federate-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-metrics-client-ca\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.474695 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.474454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-serving-certs-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.475258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.476363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-metrics-client-ca\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.476675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9551c57c-f5ba-4909-9ee6-8cc91be51963-serving-certs-ca-bundle\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.479031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-federate-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.480405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-telemeter-client-tls\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.480560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.480523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.481770 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.481603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9551c57c-f5ba-4909-9ee6-8cc91be51963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.483883 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.483860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6wz7\" (UniqueName: \"kubernetes.io/projected/9551c57c-f5ba-4909-9ee6-8cc91be51963-kube-api-access-s6wz7\") pod \"telemeter-client-7798fd8d4b-stbkz\" (UID: \"9551c57c-f5ba-4909-9ee6-8cc91be51963\") " pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.549709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.549684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:02.552461 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:02.552421    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a27c49_0880_4313_84de_e71074446b49.slice/crio-044f46b9a05da89c446888a56b26952e6bb3f307ddc3b0bce04c135a20878afd WatchSource:0}: Error finding container 044f46b9a05da89c446888a56b26952e6bb3f307ddc3b0bce04c135a20878afd: Status 404 returned error can't find the container with id 044f46b9a05da89c446888a56b26952e6bb3f307ddc3b0bce04c135a20878afd
Jul 10 18:31:02.562294 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.562268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dcf985f-lblm6" event={"ID":"06a27c49-0880-4313-84de-e71074446b49","Type":"ContainerStarted","Data":"044f46b9a05da89c446888a56b26952e6bb3f307ddc3b0bce04c135a20878afd"}
Jul 10 18:31:02.563476 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.563452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d" event={"ID":"89308245-46b2-405f-a114-6bef55e6e38d","Type":"ContainerStarted","Data":"64ca1776ecf751678df0dde65e90fce2c5751f36040d156e752623b727012b5d"}
Jul 10 18:31:02.564529 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.564510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq" event={"ID":"cad69796-7ca8-4c98-8c11-4bb681878fab","Type":"ContainerStarted","Data":"5c0da4e2c3916eed07eb344dbd8cc34845967e6dbcbf388fafc665e2f25b9d36"}
Jul 10 18:31:02.565825 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.565804    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1" exitCode=0
Jul 10 18:31:02.565916 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.565860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"}
Jul 10 18:31:02.606163 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.605941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"
Jul 10 18:31:02.793114 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:02.792947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7798fd8d4b-stbkz"]
Jul 10 18:31:02.795996 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:02.795960    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9551c57c_f5ba_4909_9ee6_8cc91be51963.slice/crio-280e4b5f9878092cf854c2ab875256399fd6e95bccd634c44d5211660a65dc5a WatchSource:0}: Error finding container 280e4b5f9878092cf854c2ab875256399fd6e95bccd634c44d5211660a65dc5a: Status 404 returned error can't find the container with id 280e4b5f9878092cf854c2ab875256399fd6e95bccd634c44d5211660a65dc5a
Jul 10 18:31:03.292803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.292765    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:31:03.296549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.296520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.299183 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.298807    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 18:31:03.299183 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.298922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 18:31:03.299598 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.299562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 18:31:03.299857 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.299840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 18:31:03.300200 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.299965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 18:31:03.300200 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.300165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 18:31:03.300944 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.300919    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 18:31:03.301571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.301222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 18:31:03.302338 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.302117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 18:31:03.305264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.302639    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b00r0usjn9b91\""
Jul 10 18:31:03.305264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.303914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lx5hq\""
Jul 10 18:31:03.305264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.304109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 18:31:03.305264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.304321    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 18:31:03.305264 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.304493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 18:31:03.308079 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.307749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 18:31:03.310419 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.310401    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 18:31:03.317531 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.317510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:31:03.383295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383579 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc94z\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.383885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.384351 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.384351 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.383928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484671 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.484870 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.484990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc94z\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485278 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.485792 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.485500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.486586 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.486555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.486709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.486582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.486709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.486593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.488842 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.488813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.488976 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.488954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.489376 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.489349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.489468 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.489429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.489776 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.489728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.490295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.490252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.490839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.490793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.491090 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.491026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.491508 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.491458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.491613 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.491544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.493409 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.493364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.493501 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.493424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.493983 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.493940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.494590 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.494567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.495938 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.495906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.502271 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.502251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc94z\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z\") pod \"prometheus-k8s-0\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:03.578153 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.574768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dcf985f-lblm6" event={"ID":"06a27c49-0880-4313-84de-e71074446b49","Type":"ContainerStarted","Data":"60cda075373b34e855aeba52403b6977d4e92d78885f0a58bd206904a6f0a771"}
Jul 10 18:31:03.578153 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.577538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz" event={"ID":"9551c57c-f5ba-4909-9ee6-8cc91be51963","Type":"ContainerStarted","Data":"280e4b5f9878092cf854c2ab875256399fd6e95bccd634c44d5211660a65dc5a"}
Jul 10 18:31:03.594424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.594362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6dcf985f-lblm6" podStartSLOduration=1.594342985 podStartE2EDuration="1.594342985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:03.59311664 +0000 UTC m=+62.976444895" watchObservedRunningTime="2026-07-10 18:31:03.594342985 +0000 UTC m=+62.977671239"
Jul 10 18:31:03.615407 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:03.615367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:04.485764 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:04.485735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4w7mf"
Jul 10 18:31:05.356102 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:05.356069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:31:05.604668 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:05.604637    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb341df83_298a_4cfa_b956_39293f6465f9.slice/crio-9711bf4860cd5517a7f48d11f855f1053ebb725d316bd91154b9437cc689ede4 WatchSource:0}: Error finding container 9711bf4860cd5517a7f48d11f855f1053ebb725d316bd91154b9437cc689ede4: Status 404 returned error can't find the container with id 9711bf4860cd5517a7f48d11f855f1053ebb725d316bd91154b9437cc689ede4
Jul 10 18:31:06.567004 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.566965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:06.567196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.567092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:06.572567 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.572536    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:06.594026 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.593991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"}
Jul 10 18:31:06.594209 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.594086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"}
Jul 10 18:31:06.594209 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.594117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"}
Jul 10 18:31:06.594209 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.594177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"}
Jul 10 18:31:06.594374 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.594219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"}
Jul 10 18:31:06.596481 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.596455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"a8e79890aa1bfca5df17e165f320704f10b1b127451fed262726ae4ec89ebc98"}
Jul 10 18:31:06.596599 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.596524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"a3bb12831e2731e467869b4f9ba920c702c8d09f3600d2935505e2bdefe6b207"}
Jul 10 18:31:06.596599 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.596566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"9fc5d8c6e18f684ffc062585d4c8c39197151e9e085cd6d81988595bccab3339"}
Jul 10 18:31:06.598076 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.598033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d" event={"ID":"89308245-46b2-405f-a114-6bef55e6e38d","Type":"ContainerStarted","Data":"646a1883f2d76749399ca90337b2be930fb065c58a43faba6f5ba6cea0694cb5"}
Jul 10 18:31:06.599754 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.599722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq" event={"ID":"cad69796-7ca8-4c98-8c11-4bb681878fab","Type":"ContainerStarted","Data":"fcec099586579bd89c69ada1e8817a92afb2f81600057defb2c31807a69ab2e1"}
Jul 10 18:31:06.599924 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.599905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:06.601625 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.601601    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976" exitCode=0
Jul 10 18:31:06.601712 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.601687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"}
Jul 10 18:31:06.601792 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.601734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"9711bf4860cd5517a7f48d11f855f1053ebb725d316bd91154b9437cc689ede4"}
Jul 10 18:31:06.605178 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.605154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz" event={"ID":"9551c57c-f5ba-4909-9ee6-8cc91be51963","Type":"ContainerStarted","Data":"472db304cf50f3cd4705d943d58496c824c94b6036e7b7093c93241730b61729"}
Jul 10 18:31:06.605525 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.605229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz" event={"ID":"9551c57c-f5ba-4909-9ee6-8cc91be51963","Type":"ContainerStarted","Data":"655a4a89f1fed647c76156c5b7fe88faa51d71a5425d9bdd512f7a3dc7a9dd65"}
Jul 10 18:31:06.605525 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.605265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz" event={"ID":"9551c57c-f5ba-4909-9ee6-8cc91be51963","Type":"ContainerStarted","Data":"54716ddf09696229962a73c02bcbee70bbdf9e70b549e5e23bc195979b050a84"}
Jul 10 18:31:06.606900 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.606882    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq"
Jul 10 18:31:06.610230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.610181    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:06.614437 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.614370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d" podStartSLOduration=1.815396872 podStartE2EDuration="5.614351202s" totalImagesPullingTime="3.79895433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:06.613792421 +0000 UTC m=+65.997120679" watchObservedRunningTime="2026-07-10 18:31:06.614351202 +0000 UTC m=+65.997679457"
Jul 10 18:31:06.645582 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.645520    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kpsxq" podStartSLOduration=2.383728157 podStartE2EDuration="5.645499314s" totalImagesPullingTime="3.261771157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:06.644628953 +0000 UTC m=+66.027957204" watchObservedRunningTime="2026-07-10 18:31:06.645499314 +0000 UTC m=+66.028827569"
Jul 10 18:31:06.669395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.669342    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7798fd8d4b-stbkz" podStartSLOduration=1.836172948 podStartE2EDuration="4.669323485s" totalImagesPullingTime="2.833150537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:06.667160237 +0000 UTC m=+66.050488493" watchObservedRunningTime="2026-07-10 18:31:06.669323485 +0000 UTC m=+66.052651720"
Jul 10 18:31:06.929590 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.929564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:31:06.931798 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.931782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:31:06.942678 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:06.942654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea19769-654d-4b21-b2c3-2b8731eaaf50-original-pull-secret\") pod \"global-pull-secret-syncer-tfxs4\" (UID: \"aea19769-654d-4b21-b2c3-2b8731eaaf50\") " pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:31:07.031106 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.031071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:31:07.031234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.031117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:31:07.033215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.033146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:31:07.033215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.033162    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:31:07.043679 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.043657    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:31:07.044281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.044263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fb5293-e0d3-49e8-893a-f0810ccff543-metrics-certs\") pod \"network-metrics-daemon-tbrcg\" (UID: \"19fb5293-e0d3-49e8-893a-f0810ccff543\") " pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:31:07.054403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.054383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdd6h\" (UniqueName: \"kubernetes.io/projected/05098a85-c484-497a-875f-f175fea11675-kube-api-access-mdd6h\") pod \"network-check-target-qszvn\" (UID: \"05098a85-c484-497a-875f-f175fea11675\") " pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:31:07.166414 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.166337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzdtl\""
Jul 10 18:31:07.172449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.172430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfxs4"
Jul 10 18:31:07.174034 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.174016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:31:07.183276 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.183250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hhh94\""
Jul 10 18:31:07.191072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.191028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbrcg"
Jul 10 18:31:07.343283 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.343234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfxs4"]
Jul 10 18:31:07.364137 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.364094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qszvn"]
Jul 10 18:31:07.368443 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:07.368404    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05098a85_c484_497a_875f_f175fea11675.slice/crio-f6daec33da149921fde82eeb5f488659a9de8c3fdac42b1da7a297ff8b60e96b WatchSource:0}: Error finding container f6daec33da149921fde82eeb5f488659a9de8c3fdac42b1da7a297ff8b60e96b: Status 404 returned error can't find the container with id f6daec33da149921fde82eeb5f488659a9de8c3fdac42b1da7a297ff8b60e96b
Jul 10 18:31:07.381985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.381152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbrcg"]
Jul 10 18:31:07.384340 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:07.384304    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fb5293_e0d3_49e8_893a_f0810ccff543.slice/crio-beead3684f97c69584caeec38573e69df53d603e446cd2b211af045cd71bdbc9 WatchSource:0}: Error finding container beead3684f97c69584caeec38573e69df53d603e446cd2b211af045cd71bdbc9: Status 404 returned error can't find the container with id beead3684f97c69584caeec38573e69df53d603e446cd2b211af045cd71bdbc9
Jul 10 18:31:07.614139 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.612549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfxs4" event={"ID":"aea19769-654d-4b21-b2c3-2b8731eaaf50","Type":"ContainerStarted","Data":"6b0bb734be90e44a0cdbdbed5b367dc332be53127cac956b24ad94c845498126"}
Jul 10 18:31:07.614139 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.614106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qszvn" event={"ID":"05098a85-c484-497a-875f-f175fea11675","Type":"ContainerStarted","Data":"f6daec33da149921fde82eeb5f488659a9de8c3fdac42b1da7a297ff8b60e96b"}
Jul 10 18:31:07.615457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.615421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbrcg" event={"ID":"19fb5293-e0d3-49e8-893a-f0810ccff543","Type":"ContainerStarted","Data":"beead3684f97c69584caeec38573e69df53d603e446cd2b211af045cd71bdbc9"}
Jul 10 18:31:07.621774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.620014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerStarted","Data":"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"}
Jul 10 18:31:07.624618 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.624587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"1f639b329b844ac12f5da5b47b0f8125c3bdc5057b51a8095aa2d2598f38da71"}
Jul 10 18:31:07.624757 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.624654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"be1cdfaa5488e53467514f73b36ea0a64061d852b744190b3514195737b9f106"}
Jul 10 18:31:07.624757 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.624699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" event={"ID":"f9840015-a21f-4f1f-b994-2319233e1c14","Type":"ContainerStarted","Data":"74fb7cbfbce927c8fb9a361fe333356a9a419510b756cf0a43cbd2229a662a01"}
Jul 10 18:31:07.649566 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.649236    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.602802653 podStartE2EDuration="9.649212066s" totalImagesPullingTime="6.02598629s" totalInitContainerRuntime="20.423123ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:07.647871434 +0000 UTC m=+67.031199688" watchObservedRunningTime="2026-07-10 18:31:07.649212066 +0000 UTC m=+67.032540321"
Jul 10 18:31:07.670805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:07.670753    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7" podStartSLOduration=2.424993047 podStartE2EDuration="7.670734767s" totalImagesPullingTime="5.24574172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:07.669202091 +0000 UTC m=+67.052530367" watchObservedRunningTime="2026-07-10 18:31:07.670734767 +0000 UTC m=+67.054063020"
Jul 10 18:31:08.633515 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:08.633429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:09.039808 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.039068    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:09.079865 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.079836    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:31:09.100920 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.100539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.104730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.104669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:31:09.262376 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qw7t\" (UniqueName: \"kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.262828 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.262641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.363970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.363870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.363970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.363955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.364196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.364008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.364196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.364034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qw7t\" (UniqueName: \"kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.364196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.364083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.364196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.364136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.364196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.364186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.365962 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.365256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.365962 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.365349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.365962 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.365506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.365962 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.365899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.369191 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.369166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.370838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.370810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.381314 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.381286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qw7t\" (UniqueName: \"kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t\") pod \"console-cd9f6b5dd-q9mcv\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") " pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.416964 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.416908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:09.652586 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:09.652558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:31:09.655029 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:31:09.654987    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d1f935_976f_4437_996f_767c18582c07.slice/crio-54ec3b49109e5c5bb4bdf8fad35e790655c9ed8272c0ef93b38441c8fb77d80a WatchSource:0}: Error finding container 54ec3b49109e5c5bb4bdf8fad35e790655c9ed8272c0ef93b38441c8fb77d80a: Status 404 returned error can't find the container with id 54ec3b49109e5c5bb4bdf8fad35e790655c9ed8272c0ef93b38441c8fb77d80a
Jul 10 18:31:10.645977 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:10.645934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f6b5dd-q9mcv" event={"ID":"d2d1f935-976f-4437-996f-767c18582c07","Type":"ContainerStarted","Data":"54ec3b49109e5c5bb4bdf8fad35e790655c9ed8272c0ef93b38441c8fb77d80a"}
Jul 10 18:31:10.647712 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:10.647676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbrcg" event={"ID":"19fb5293-e0d3-49e8-893a-f0810ccff543","Type":"ContainerStarted","Data":"0cb1b1aa8e6a7b0435e9297c35b056f0feb8017d0bee7c91e2635c06d94f9621"}
Jul 10 18:31:12.401565 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:12.401528    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:13.673750 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.673680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qszvn" event={"ID":"05098a85-c484-497a-875f-f175fea11675","Type":"ContainerStarted","Data":"c967904fad1ee53ffe1d454cce2bfa974df6d571a3517759f4349cfda5491f47"}
Jul 10 18:31:13.674216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.673821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:31:13.675873 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.675839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f6b5dd-q9mcv" event={"ID":"d2d1f935-976f-4437-996f-767c18582c07","Type":"ContainerStarted","Data":"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"}
Jul 10 18:31:13.677748 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.677696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbrcg" event={"ID":"19fb5293-e0d3-49e8-893a-f0810ccff543","Type":"ContainerStarted","Data":"2fd628db095d795bbf028dbf97b8fddcc079716fdf6fe64bd3e1655d283e7af0"}
Jul 10 18:31:13.680558 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.680534    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"}
Jul 10 18:31:13.680672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.680588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"}
Jul 10 18:31:13.680672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.680619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"}
Jul 10 18:31:13.680774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.680656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"}
Jul 10 18:31:13.682440 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.682419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfxs4" event={"ID":"aea19769-654d-4b21-b2c3-2b8731eaaf50","Type":"ContainerStarted","Data":"2e68ea9a2e51f03b2278eff0e34c42ac651a8b7899aa3ebc992038436b642700"}
Jul 10 18:31:13.690455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.690395    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qszvn" podStartSLOduration=65.781288494 podStartE2EDuration="1m11.690378363s" totalImagesPullingTime="5.909089869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:13.688204139 +0000 UTC m=+73.071532384" watchObservedRunningTime="2026-07-10 18:31:13.690378363 +0000 UTC m=+73.073706618"
Jul 10 18:31:13.705118 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.705070    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd9f6b5dd-q9mcv" podStartSLOduration=4.70502039 podStartE2EDuration="4.70502039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:13.704148449 +0000 UTC m=+73.087476718" watchObservedRunningTime="2026-07-10 18:31:13.70502039 +0000 UTC m=+73.088348644"
Jul 10 18:31:13.718752 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.718702    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tfxs4" podStartSLOduration=65.783005504 podStartE2EDuration="1m11.718665733s" totalImagesPullingTime="5.935660229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:13.717075454 +0000 UTC m=+73.100403709" watchObservedRunningTime="2026-07-10 18:31:13.718665733 +0000 UTC m=+73.101993988"
Jul 10 18:31:13.733074 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:13.732568    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tbrcg" podStartSLOduration=69.638980031 podStartE2EDuration="1m11.732549086s" totalImagesPullingTime="2.093569055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:13.731019341 +0000 UTC m=+73.114347605" watchObservedRunningTime="2026-07-10 18:31:13.732549086 +0000 UTC m=+73.115877377"
Jul 10 18:31:14.645060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:14.645013    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74547b45-4c8n7"
Jul 10 18:31:14.692147 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:14.692105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"}
Jul 10 18:31:14.692575 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:14.692178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerStarted","Data":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"}
Jul 10 18:31:14.723926 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:14.722334    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.021546052 podStartE2EDuration="11.72231191s" totalImagesPullingTime="6.674480246s" totalInitContainerRuntime="26.285612ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:14.720055456 +0000 UTC m=+74.103383702" watchObservedRunningTime="2026-07-10 18:31:14.72231191 +0000 UTC m=+74.105640165"
Jul 10 18:31:18.616534 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:18.616502    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:31:19.417954 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:19.417915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:19.418155 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:19.417985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:19.422702 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:19.422678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:19.723375 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:19.723298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:31:19.767831 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:19.767797    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:31:21.691783 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:21.691741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:21.692208 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:21.691833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:34.071252 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.071113    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c6dcf985f-lblm6" podUID="06a27c49-0880-4313-84de-e71074446b49" containerName="console" containerID="cri-o://60cda075373b34e855aeba52403b6977d4e92d78885f0a58bd206904a6f0a771" gracePeriod=15
Jul 10 18:31:34.785283 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.785247    2580 generic.go:356] "Generic (PLEG): container finished" podID="06a27c49-0880-4313-84de-e71074446b49" containerID="60cda075373b34e855aeba52403b6977d4e92d78885f0a58bd206904a6f0a771" exitCode=0
Jul 10 18:31:34.785458 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.785316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dcf985f-lblm6" event={"ID":"06a27c49-0880-4313-84de-e71074446b49","Type":"ContainerDied","Data":"60cda075373b34e855aeba52403b6977d4e92d78885f0a58bd206904a6f0a771"}
Jul 10 18:31:34.853622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.853595    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:34.905254 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905150    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905433 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905433 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905433 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905433 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905396    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcdlb\" (UniqueName: \"kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905433 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905681 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config\") pod \"06a27c49-0880-4313-84de-e71074446b49\" (UID: \"06a27c49-0880-4313-84de-e71074446b49\") "
Jul 10 18:31:34.905681 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905497    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:34.905783 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905697    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca" (OuterVolumeSpecName: "service-ca") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:34.905783 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905768    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-oauth-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:34.905892 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905788    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:34.905980 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config" (OuterVolumeSpecName: "console-config") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:34.906032 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.905955    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:34.907694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.907669    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:34.907805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.907689    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb" (OuterVolumeSpecName: "kube-api-access-fcdlb") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "kube-api-access-fcdlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:31:34.907805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:34.907723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06a27c49-0880-4313-84de-e71074446b49" (UID: "06a27c49-0880-4313-84de-e71074446b49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:35.006996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.006909    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-oauth-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:35.006996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.006941    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcdlb\" (UniqueName: \"kubernetes.io/projected/06a27c49-0880-4313-84de-e71074446b49-kube-api-access-fcdlb\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:35.006996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.006951    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-trusted-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:35.006996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.006961    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06a27c49-0880-4313-84de-e71074446b49-console-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:35.006996 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.006970    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06a27c49-0880-4313-84de-e71074446b49-console-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:35.795407 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.795374    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dcf985f-lblm6"
Jul 10 18:31:35.795834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.795385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dcf985f-lblm6" event={"ID":"06a27c49-0880-4313-84de-e71074446b49","Type":"ContainerDied","Data":"044f46b9a05da89c446888a56b26952e6bb3f307ddc3b0bce04c135a20878afd"}
Jul 10 18:31:35.795834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.795520    2580 scope.go:117] "RemoveContainer" containerID="60cda075373b34e855aeba52403b6977d4e92d78885f0a58bd206904a6f0a771"
Jul 10 18:31:35.810740 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.810707    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:35.814919 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:35.814896    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6dcf985f-lblm6"]
Jul 10 18:31:37.251754 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:37.251711    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a27c49-0880-4313-84de-e71074446b49" path="/var/lib/kubelet/pods/06a27c49-0880-4313-84de-e71074446b49/volumes"
Jul 10 18:31:40.793404 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:40.793372    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/init-config-reloader/0.log"
Jul 10 18:31:40.988162 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:40.988121    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/alertmanager/0.log"
Jul 10 18:31:41.187330 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.187256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/config-reloader/0.log"
Jul 10 18:31:41.386834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.386774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/kube-rbac-proxy-web/0.log"
Jul 10 18:31:41.587173 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.587145    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/kube-rbac-proxy/0.log"
Jul 10 18:31:41.696520 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.696492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:41.700260 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.700236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f88d87764-mlf6d"
Jul 10 18:31:41.787899 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.787873    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/kube-rbac-proxy-metric/0.log"
Jul 10 18:31:41.987770 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:41.987693    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e926329a-edd9-4cd1-bcde-8532ee7b8239/prom-label-proxy/0.log"
Jul 10 18:31:42.387836 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:42.387774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-state-metrics/0.log"
Jul 10 18:31:42.588006 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:42.587969    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-rbac-proxy-main/0.log"
Jul 10 18:31:42.787069 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:42.787020    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-rbac-proxy-self/0.log"
Jul 10 18:31:42.987378 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:42.987353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f88d87764-mlf6d_89308245-46b2-405f-a114-6bef55e6e38d/metrics-server/0.log"
Jul 10 18:31:43.187340 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:43.187276    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-kpsxq_cad69796-7ca8-4c98-8c11-4bb681878fab/monitoring-plugin/0.log"
Jul 10 18:31:44.587604 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:44.587577    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/init-textfile/0.log"
Jul 10 18:31:44.695265 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:44.695237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qszvn"
Jul 10 18:31:44.788449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:44.788416    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/node-exporter/0.log"
Jul 10 18:31:44.788659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:44.788632    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f94c6cb67-6gc4v" podUID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" containerName="console" containerID="cri-o://38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77" gracePeriod=15
Jul 10 18:31:44.987031 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:44.986999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/kube-rbac-proxy/0.log"
Jul 10 18:31:45.081188 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.081159    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:45.186514 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.186439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/kube-rbac-proxy-main/0.log"
Jul 10 18:31:45.191602 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfz8t\" (UniqueName: \"kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191936 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.191936 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert\") pod \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\" (UID: \"bc7d792f-7f5d-468b-84ce-2d2e933d54d7\") "
Jul 10 18:31:45.192025 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.191989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:45.192170 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.192148    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-trusted-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.192293 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.192173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config" (OuterVolumeSpecName: "console-config") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:45.192293 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.192189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:45.192293 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.192253    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:31:45.193981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.193953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:45.194175 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.193977    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t" (OuterVolumeSpecName: "kube-api-access-bfz8t") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "kube-api-access-bfz8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:31:45.194175 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.194013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc7d792f-7f5d-468b-84ce-2d2e933d54d7" (UID: "bc7d792f-7f5d-468b-84ce-2d2e933d54d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:45.293353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293322    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.293353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293352    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.293542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293363    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.293542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293372    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-console-oauth-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.293542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293380    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfz8t\" (UniqueName: \"kubernetes.io/projected/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-kube-api-access-bfz8t\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.293542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.293389    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc7d792f-7f5d-468b-84ce-2d2e933d54d7-oauth-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:31:45.388335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.388303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/kube-rbac-proxy-self/0.log"
Jul 10 18:31:45.586875 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.586850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/openshift-state-metrics/0.log"
Jul 10 18:31:45.787460 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.787433    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/init-config-reloader/0.log"
Jul 10 18:31:45.838985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.838904    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" containerID="38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77" exitCode=0
Jul 10 18:31:45.838985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.838961    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f94c6cb67-6gc4v"
Jul 10 18:31:45.838985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.838968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f94c6cb67-6gc4v" event={"ID":"bc7d792f-7f5d-468b-84ce-2d2e933d54d7","Type":"ContainerDied","Data":"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"}
Jul 10 18:31:45.839266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.839019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f94c6cb67-6gc4v" event={"ID":"bc7d792f-7f5d-468b-84ce-2d2e933d54d7","Type":"ContainerDied","Data":"94cbd1638c4a5acf1ce3dcb76b0eb6d7f61983bb967979ae316d774a0ad6d230"}
Jul 10 18:31:45.839266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.839065    2580 scope.go:117] "RemoveContainer" containerID="38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"
Jul 10 18:31:45.847407 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.847392    2580 scope.go:117] "RemoveContainer" containerID="38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"
Jul 10 18:31:45.847675 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:31:45.847656    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77\": container with ID starting with 38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77 not found: ID does not exist" containerID="38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"
Jul 10 18:31:45.847732 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.847682    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77"} err="failed to get container status \"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77\": rpc error: code = NotFound desc = could not find container \"38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77\": container with ID starting with 38eda9e94c66c263a1d3cfe95bcaab32059f5f08908b850be5143dcc4cedde77 not found: ID does not exist"
Jul 10 18:31:45.854428 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.854399    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:31:45.862394 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.862373    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f94c6cb67-6gc4v"]
Jul 10 18:31:45.988825 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:45.988796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/prometheus/0.log"
Jul 10 18:31:46.187561 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:46.187490    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/config-reloader/0.log"
Jul 10 18:31:46.387716 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:46.387687    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/thanos-sidecar/0.log"
Jul 10 18:31:46.587090 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:46.587034    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/kube-rbac-proxy-web/0.log"
Jul 10 18:31:46.787216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:46.787189    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/kube-rbac-proxy/0.log"
Jul 10 18:31:46.987983 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:46.987909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b341df83-298a-4cfa-b956-39293f6465f9/kube-rbac-proxy-thanos/0.log"
Jul 10 18:31:47.188934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:47.188905    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gplk5_fc245db1-f00b-40a2-8f13-1092607c45c6/prometheus-operator/0.log"
Jul 10 18:31:47.251791 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:47.251710    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" path="/var/lib/kubelet/pods/bc7d792f-7f5d-468b-84ce-2d2e933d54d7/volumes"
Jul 10 18:31:47.387823 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:47.387791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gplk5_fc245db1-f00b-40a2-8f13-1092607c45c6/kube-rbac-proxy/0.log"
Jul 10 18:31:47.792202 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:47.792171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/telemeter-client/0.log"
Jul 10 18:31:47.988109 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:47.988083    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/reload/0.log"
Jul 10 18:31:48.187659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:48.187581    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/kube-rbac-proxy/0.log"
Jul 10 18:31:48.387667 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:48.387643    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/thanos-query/0.log"
Jul 10 18:31:48.586838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:48.586815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-web/0.log"
Jul 10 18:31:48.788201 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:48.788176    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy/0.log"
Jul 10 18:31:48.987246 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:48.987174    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/prom-label-proxy/0.log"
Jul 10 18:31:49.187482 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:49.187455    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-rules/0.log"
Jul 10 18:31:49.388675 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:49.388652    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-metrics/0.log"
Jul 10 18:31:50.187984 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:50.187958    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd9f6b5dd-q9mcv_d2d1f935-976f-4437-996f-767c18582c07/console/0.log"
Jul 10 18:31:51.187327 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:31:51.187299    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j6swc_7f9323ae-6984-4ace-b753-c82abf786b87/serve-healthcheck-canary/0.log"
Jul 10 18:32:03.615881 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:03.615845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:03.635705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:03.635679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:03.929778 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:03.929700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:17.395769 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.395727    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396018    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="alertmanager" containerID="cri-o://5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5" gracePeriod=120
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396099    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-metric" containerID="cri-o://593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e" gracePeriod=120
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396138    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-web" containerID="cri-o://43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875" gracePeriod=120
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396162    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="config-reloader" containerID="cri-o://29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574" gracePeriod=120
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396216    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy" containerID="cri-o://94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90" gracePeriod=120
Jul 10 18:32:17.396345 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.396244    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="prom-label-proxy" containerID="cri-o://db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9" gracePeriod=120
Jul 10 18:32:17.976303 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976263    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9" exitCode=0
Jul 10 18:32:17.976303 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976292    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90" exitCode=0
Jul 10 18:32:17.976303 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976302    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574" exitCode=0
Jul 10 18:32:17.976303 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976309    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5" exitCode=0
Jul 10 18:32:17.976570 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"}
Jul 10 18:32:17.976570 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"}
Jul 10 18:32:17.976570 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"}
Jul 10 18:32:17.976570 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:17.976452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"}
Jul 10 18:32:18.645216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.645192    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:18.697851 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.697817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.697861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.697896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.697923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:32:18.698217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698291    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctfvm\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698333    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698366    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698453 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca\") pod \"e926329a-edd9-4cd1-bcde-8532ee7b8239\" (UID: \"e926329a-edd9-4cd1-bcde-8532ee7b8239\") "
Jul 10 18:32:18.698710 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698689    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-main-db\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.698761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.698708    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.699360 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.699101    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:18.701658 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.701616    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:32:18.703116 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.702869    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.703116 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.703072    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.703304 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.703241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.703366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.703337    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out" (OuterVolumeSpecName: "config-out") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:32:18.704078 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.704027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.704201 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.704178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume" (OuterVolumeSpecName: "config-volume") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.704605 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.704583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm" (OuterVolumeSpecName: "kube-api-access-ctfvm") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "kube-api-access-ctfvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:32:18.707810 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.707786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.714302 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.714280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config" (OuterVolumeSpecName: "web-config") pod "e926329a-edd9-4cd1-bcde-8532ee7b8239" (UID: "e926329a-edd9-4cd1-bcde-8532ee7b8239"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:18.799849 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799814    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799874    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-web-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799888    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-tls-assets\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799898    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctfvm\" (UniqueName: \"kubernetes.io/projected/e926329a-edd9-4cd1-bcde-8532ee7b8239-kube-api-access-ctfvm\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799910    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-main-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799922    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-out\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799933    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e926329a-edd9-4cd1-bcde-8532ee7b8239-metrics-client-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799944    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-cluster-tls-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799956    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799970    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-config-volume\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.800015 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.799981    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e926329a-edd9-4cd1-bcde-8532ee7b8239-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:18.986350 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986312    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e" exitCode=0
Jul 10 18:32:18.986350 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986338    2580 generic.go:356] "Generic (PLEG): container finished" podID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerID="43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875" exitCode=0
Jul 10 18:32:18.986589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:18.986589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"}
Jul 10 18:32:18.986589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"}
Jul 10 18:32:18.986589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e926329a-edd9-4cd1-bcde-8532ee7b8239","Type":"ContainerDied","Data":"d1fb875f5d0d9744cbd75803e56a2779f6c32cb917ceef0c0c02067104e43ce1"}
Jul 10 18:32:18.986589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.986553    2580 scope.go:117] "RemoveContainer" containerID="db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"
Jul 10 18:32:18.994779 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:18.994764    2580 scope.go:117] "RemoveContainer" containerID="593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"
Jul 10 18:32:19.001960 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.001942    2580 scope.go:117] "RemoveContainer" containerID="94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"
Jul 10 18:32:19.009215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.009194    2580 scope.go:117] "RemoveContainer" containerID="43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"
Jul 10 18:32:19.009851 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.009830    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:19.014493 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.014471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:19.017005 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.016978    2580 scope.go:117] "RemoveContainer" containerID="29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"
Jul 10 18:32:19.024137 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.024118    2580 scope.go:117] "RemoveContainer" containerID="5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"
Jul 10 18:32:19.030987 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.030965    2580 scope.go:117] "RemoveContainer" containerID="9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"
Jul 10 18:32:19.037775 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.037761    2580 scope.go:117] "RemoveContainer" containerID="db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"
Jul 10 18:32:19.037997 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.037978    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9\": container with ID starting with db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9 not found: ID does not exist" containerID="db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"
Jul 10 18:32:19.038046 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038007    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"} err="failed to get container status \"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9\": rpc error: code = NotFound desc = could not find container \"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9\": container with ID starting with db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9 not found: ID does not exist"
Jul 10 18:32:19.038046 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038026    2580 scope.go:117] "RemoveContainer" containerID="593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"
Jul 10 18:32:19.038245 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.038229    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e\": container with ID starting with 593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e not found: ID does not exist" containerID="593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"
Jul 10 18:32:19.038277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038251    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"} err="failed to get container status \"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e\": rpc error: code = NotFound desc = could not find container \"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e\": container with ID starting with 593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e not found: ID does not exist"
Jul 10 18:32:19.038277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038266    2580 scope.go:117] "RemoveContainer" containerID="94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"
Jul 10 18:32:19.038496 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.038481    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90\": container with ID starting with 94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90 not found: ID does not exist" containerID="94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"
Jul 10 18:32:19.038543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038498    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"} err="failed to get container status \"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90\": rpc error: code = NotFound desc = could not find container \"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90\": container with ID starting with 94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90 not found: ID does not exist"
Jul 10 18:32:19.038543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038511    2580 scope.go:117] "RemoveContainer" containerID="43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"
Jul 10 18:32:19.038722 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.038709    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875\": container with ID starting with 43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875 not found: ID does not exist" containerID="43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"
Jul 10 18:32:19.038756 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038725    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"} err="failed to get container status \"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875\": rpc error: code = NotFound desc = could not find container \"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875\": container with ID starting with 43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875 not found: ID does not exist"
Jul 10 18:32:19.038756 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038736    2580 scope.go:117] "RemoveContainer" containerID="29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"
Jul 10 18:32:19.038933 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.038918    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574\": container with ID starting with 29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574 not found: ID does not exist" containerID="29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"
Jul 10 18:32:19.038964 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038936    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"} err="failed to get container status \"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574\": rpc error: code = NotFound desc = could not find container \"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574\": container with ID starting with 29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574 not found: ID does not exist"
Jul 10 18:32:19.038964 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.038949    2580 scope.go:117] "RemoveContainer" containerID="5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"
Jul 10 18:32:19.039160 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.039146    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5\": container with ID starting with 5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5 not found: ID does not exist" containerID="5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"
Jul 10 18:32:19.039206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039163    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"} err="failed to get container status \"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5\": rpc error: code = NotFound desc = could not find container \"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5\": container with ID starting with 5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5 not found: ID does not exist"
Jul 10 18:32:19.039206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039175    2580 scope.go:117] "RemoveContainer" containerID="9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"
Jul 10 18:32:19.039354 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:19.039341    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1\": container with ID starting with 9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1 not found: ID does not exist" containerID="9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"
Jul 10 18:32:19.039388 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039358    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"} err="failed to get container status \"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1\": rpc error: code = NotFound desc = could not find container \"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1\": container with ID starting with 9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1 not found: ID does not exist"
Jul 10 18:32:19.039388 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039380    2580 scope.go:117] "RemoveContainer" containerID="db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"
Jul 10 18:32:19.039563 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039549    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9"} err="failed to get container status \"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9\": rpc error: code = NotFound desc = could not find container \"db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9\": container with ID starting with db3393f5c8d437e1a84574b42fb77d586f279e68001875695bcd12ce1cefc6f9 not found: ID does not exist"
Jul 10 18:32:19.039599 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039564    2580 scope.go:117] "RemoveContainer" containerID="593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"
Jul 10 18:32:19.039761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039739    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e"} err="failed to get container status \"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e\": rpc error: code = NotFound desc = could not find container \"593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e\": container with ID starting with 593bd39f8bae15a8dda3a60495a49be6e9598cb7fa666b2458e207f3de24b32e not found: ID does not exist"
Jul 10 18:32:19.039799 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039760    2580 scope.go:117] "RemoveContainer" containerID="94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"
Jul 10 18:32:19.039978 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039955    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90"} err="failed to get container status \"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90\": rpc error: code = NotFound desc = could not find container \"94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90\": container with ID starting with 94d229b3600bf28750b1112e229093605abf3fa97fd398f29f27eb6d8bbadd90 not found: ID does not exist"
Jul 10 18:32:19.039978 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.039976    2580 scope.go:117] "RemoveContainer" containerID="43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"
Jul 10 18:32:19.040219 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875"} err="failed to get container status \"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875\": rpc error: code = NotFound desc = could not find container \"43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875\": container with ID starting with 43739c779c288a3056fbbbdcd2ee96f918923b611efe1af975462125c0918875 not found: ID does not exist"
Jul 10 18:32:19.040274 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040220    2580 scope.go:117] "RemoveContainer" containerID="29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"
Jul 10 18:32:19.040451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040434    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574"} err="failed to get container status \"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574\": rpc error: code = NotFound desc = could not find container \"29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574\": container with ID starting with 29034a2952019ff86cf3271f9ab67d96cdaf24ee7b75315eccb1c0af89646574 not found: ID does not exist"
Jul 10 18:32:19.040451 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040450    2580 scope.go:117] "RemoveContainer" containerID="5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"
Jul 10 18:32:19.040665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040647    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5"} err="failed to get container status \"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5\": rpc error: code = NotFound desc = could not find container \"5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5\": container with ID starting with 5d394fe663beab4b575eaa51db69e21cfed09a265381e5d9eb3d7c3cf0cb60e5 not found: ID does not exist"
Jul 10 18:32:19.040665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040665    2580 scope.go:117] "RemoveContainer" containerID="9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"
Jul 10 18:32:19.040855 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.040841    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1"} err="failed to get container status \"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1\": rpc error: code = NotFound desc = could not find container \"9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1\": container with ID starting with 9719340b2c1db3cf00ff527a8441a932e13dd14a598fd3c16efb5bc01ac21ca1 not found: ID does not exist"
Jul 10 18:32:19.053690 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.053625    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:19.054681 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.054639    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a27c49-0880-4313-84de-e71074446b49" containerName="console"
Jul 10 18:32:19.054837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.054660    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a27c49-0880-4313-84de-e71074446b49" containerName="console"
Jul 10 18:32:19.054837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.054801    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-metric"
Jul 10 18:32:19.054837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.054812    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-metric"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055030    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055069    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055083    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-web"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055092    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-web"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055112    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="alertmanager"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055120    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="alertmanager"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055140    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="init-config-reloader"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055149    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="init-config-reloader"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055179    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="prom-label-proxy"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055187    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="prom-label-proxy"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055199    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" containerName="console"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055208    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" containerName="console"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055228    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="config-reloader"
Jul 10 18:32:19.055281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.055236    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="config-reloader"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056095    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-web"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056122    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056135    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a27c49-0880-4313-84de-e71074446b49" containerName="console"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056145    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="config-reloader"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056161    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="prom-label-proxy"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056171    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7d792f-7f5d-468b-84ce-2d2e933d54d7" containerName="console"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056185    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="alertmanager"
Jul 10 18:32:19.056366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.056195    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" containerName="kube-rbac-proxy-metric"
Jul 10 18:32:19.061001 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.060979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.063128 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 18:32:19.063226 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 18:32:19.063286 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063239    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dxfq7\""
Jul 10 18:32:19.063286 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 18:32:19.063286 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 18:32:19.063547 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 18:32:19.063772 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063757    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 18:32:19.063843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 18:32:19.063843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.063833    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 18:32:19.067785 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.067767    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 18:32:19.072410 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.072392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:19.103340 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103340 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103539 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.103784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.103684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkqpk\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-kube-api-access-bkqpk\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204480 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204480 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkqpk\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-kube-api-access-bkqpk\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.204747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.205230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.205230 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.204787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.205719 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.205662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.205855 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.205829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.206349 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.206323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1447c-35b2-4b82-b39b-41892a0541b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.207576 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.207548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.207686 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.207600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.207928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.207898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.208358 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.208337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.208449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.208405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.208449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.208426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.208449 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.208436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1447c-35b2-4b82-b39b-41892a0541b0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.208574 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.208558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.209148 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.209132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1447c-35b2-4b82-b39b-41892a0541b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.212371 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.212349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkqpk\" (UniqueName: \"kubernetes.io/projected/1ea1447c-35b2-4b82-b39b-41892a0541b0-kube-api-access-bkqpk\") pod \"alertmanager-main-0\" (UID: \"1ea1447c-35b2-4b82-b39b-41892a0541b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.251215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.251176    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e926329a-edd9-4cd1-bcde-8532ee7b8239" path="/var/lib/kubelet/pods/e926329a-edd9-4cd1-bcde-8532ee7b8239/volumes"
Jul 10 18:32:19.370924 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.370827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 18:32:19.500827 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.500711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 18:32:19.503999 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:32:19.503966    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea1447c_35b2_4b82_b39b_41892a0541b0.slice/crio-17e0d3d9166ec18d2e220d73caabb77346e9866d99ac8a955b1e4132a8ea97b0 WatchSource:0}: Error finding container 17e0d3d9166ec18d2e220d73caabb77346e9866d99ac8a955b1e4132a8ea97b0: Status 404 returned error can't find the container with id 17e0d3d9166ec18d2e220d73caabb77346e9866d99ac8a955b1e4132a8ea97b0
Jul 10 18:32:19.993052 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.993003    2580 generic.go:356] "Generic (PLEG): container finished" podID="1ea1447c-35b2-4b82-b39b-41892a0541b0" containerID="63343200c6a95b97581d63c9ddbb1d0b78b08581ba1f3defd983f0b9b7ab31ff" exitCode=0
Jul 10 18:32:19.993402 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.993096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerDied","Data":"63343200c6a95b97581d63c9ddbb1d0b78b08581ba1f3defd983f0b9b7ab31ff"}
Jul 10 18:32:19.993402 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:19.993167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"17e0d3d9166ec18d2e220d73caabb77346e9866d99ac8a955b1e4132a8ea97b0"}
Jul 10 18:32:21.000407 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"59fea96eb58f1dfdb16243df27e784759b5e987231b5f441e78d62e5ca652a5e"}
Jul 10 18:32:21.000856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"1c2056cdc1f59893f8f706b3460fb9362a94138e5466573256de7f0ac8ad09dc"}
Jul 10 18:32:21.000856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"11a426d4cf0cf0d8cd5d2197f70c8d63fd8b364d432477aa4b86a845f9ecefc6"}
Jul 10 18:32:21.000856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"9e32be9f2554414b5e82e47e03a8561b4400e87781250814bb30c4253d341d35"}
Jul 10 18:32:21.000856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"0a8d22bc1112149dc87870e84b910772dd1f67e72d19ebc66c492d3974b307a4"}
Jul 10 18:32:21.000856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.000626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1447c-35b2-4b82-b39b-41892a0541b0","Type":"ContainerStarted","Data":"691880ed7610730b70fc9d023203cef35bcb0040378dd55b7cbb1a81ed057d0a"}
Jul 10 18:32:21.025052 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.025003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.009851416 podStartE2EDuration="2.024988778s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.137362ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:21.023652424 +0000 UTC m=+140.406980670" watchObservedRunningTime="2026-07-10 18:32:21.024988778 +0000 UTC m=+140.408317033"
Jul 10 18:32:21.641765 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.641725    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:21.642146 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642112    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="prometheus" containerID="cri-o://a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64" gracePeriod=600
Jul 10 18:32:21.642811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642295    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy" containerID="cri-o://95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173" gracePeriod=600
Jul 10 18:32:21.642811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642397    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-web" containerID="cri-o://29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533" gracePeriod=600
Jul 10 18:32:21.642811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642558    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="thanos-sidecar" containerID="cri-o://c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa" gracePeriod=600
Jul 10 18:32:21.642811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642121    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51" gracePeriod=600
Jul 10 18:32:21.642811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.642711    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="config-reloader" containerID="cri-o://dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5" gracePeriod=600
Jul 10 18:32:21.893551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.893490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927795    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927844    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927867    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.927999    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc94z\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.928969 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.929985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928360    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.929985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.928392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file\") pod \"b341df83-298a-4cfa-b956-39293f6465f9\" (UID: \"b341df83-298a-4cfa-b956-39293f6465f9\") "
Jul 10 18:32:21.930753 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.930501    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.931103 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.931074    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.933713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.931708    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.933713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.932752    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.933713 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.932841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:32:21.934981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.934820    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.935383 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.935164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.935383 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.935253    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:21.935761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.935717    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.935761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.935723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:32:21.936258 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.936224    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z" (OuterVolumeSpecName: "kube-api-access-vc94z") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "kube-api-access-vc94z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:32:21.936410 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.936367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.936886 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.936848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out" (OuterVolumeSpecName: "config-out") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:32:21.937004 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.936908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.937346 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.937321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.938376 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.938338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.938605 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.938558    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.938742 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.938722    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.938846 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.938822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config" (OuterVolumeSpecName: "config") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:21.952546 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:21.952516    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config" (OuterVolumeSpecName: "web-config") pod "b341df83-298a-4cfa-b956-39293f6465f9" (UID: "b341df83-298a-4cfa-b956-39293f6465f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:22.007227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007191    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51" exitCode=0
Jul 10 18:32:22.007227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007223    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173" exitCode=0
Jul 10 18:32:22.007227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007233    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533" exitCode=0
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007241    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa" exitCode=0
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007250    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5" exitCode=0
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007259    2580 generic.go:356] "Generic (PLEG): container finished" podID="b341df83-298a-4cfa-b956-39293f6465f9" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64" exitCode=0
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007284    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"}
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007436    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.007705 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.007459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b341df83-298a-4cfa-b956-39293f6465f9","Type":"ContainerDied","Data":"9711bf4860cd5517a7f48d11f855f1053ebb725d316bd91154b9437cc689ede4"}
Jul 10 18:32:22.016728 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.016395    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.025158 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.025137    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.029482 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029459    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-metrics-client-certs\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029490    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029506    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029520    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029534    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029551 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029548    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-kube-rbac-proxy\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029561    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029575    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-web-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029587    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029601    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-grpc-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029613    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-config-out\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029626    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-db\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029639    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029655    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029668    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-configmap-metrics-client-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029684    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc94z\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-kube-api-access-vc94z\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029699    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029712    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b341df83-298a-4cfa-b956-39293f6465f9-tls-assets\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029725    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b341df83-298a-4cfa-b956-39293f6465f9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.029972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.029738    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b341df83-298a-4cfa-b956-39293f6465f9-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:22.032431 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.032352    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.035083 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.035060    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:22.038779 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.038756    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:22.041988 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.041972    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.048588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.048570    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.056007 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.055987    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.062617 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.062595    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.062846 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.062826    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.062925 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.062860    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.062925 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.062887    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.063154 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.063127    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.063227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063162    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.063227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063184    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.063403 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.063385    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.063438 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063409    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.063438 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063423    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.063618 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.063600    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.063659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063627    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.063659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063642    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.063845 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.063829    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.063902 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063851    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.063902 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.063869    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.064137 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.064069    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.064137 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064088    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.064137 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064099    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.064435 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:22.064362    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.064435 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064391    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.064435 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064410    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.064807 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064697    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.064807 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064724    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.065112 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.064983    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.065112 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065008    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.065417 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065398    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.065495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065419    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.065693 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065674    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.065738 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065697    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.065940 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065922    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.065992 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.065941    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.066190 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.066238 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066191    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.066446 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066429    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.066484 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066447    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.066652 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066635    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.066698 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066652    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.066698 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066673    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:22.066876 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066861    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.066876 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066876    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.066985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066972    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy"
Jul 10 18:32:22.067027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.066989    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy"
Jul 10 18:32:22.067027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067002    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="init-config-reloader"
Jul 10 18:32:22.067027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067011    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="init-config-reloader"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067030    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="config-reloader"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067052    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="config-reloader"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067071    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="prometheus"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067079    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="prometheus"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067100    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="thanos-sidecar"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067108    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="thanos-sidecar"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067116    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-web"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067125    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-web"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067134    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-thanos"
Jul 10 18:32:22.067143 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067142    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-thanos"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067147    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067161    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067199    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-web"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067208    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067220    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="prometheus"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067229    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="kube-rbac-proxy-thanos"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067237    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="config-reloader"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067244    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b341df83-298a-4cfa-b956-39293f6465f9" containerName="thanos-sidecar"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067343    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.067455 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067356    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.067856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067551    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.067856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.067578    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.068226 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068105    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.068226 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068137    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.068470 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068438    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.068470 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068462    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.068715 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068697    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.068784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068717    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.068949 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068928    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.068995 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.068950    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.069187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069168    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.069227 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069188    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.069412 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069391    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.069412 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069409    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.069620 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069596    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.069661 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069623    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.069860 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069841    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.069928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.069862    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.070113 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070086    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.070113 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070103    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.070319 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070302    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.070364 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070321    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.070496 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070479    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.070542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070496    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.070714 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070695    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.070779 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070716    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.070903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070887    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.070973 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.070904    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.071149 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071131    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.071222 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071150    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.071286 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.071363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071347    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.071419 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071365    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.071805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071758    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.071805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.071787    2580 scope.go:117] "RemoveContainer" containerID="db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"
Jul 10 18:32:22.072111 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072029    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51"} err="failed to get container status \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": rpc error: code = NotFound desc = could not find container \"db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51\": container with ID starting with db5d977415e3f0325224097acabc40fc5cc065eed92d46ef734cb9aaae38eb51 not found: ID does not exist"
Jul 10 18:32:22.072111 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072075    2580 scope.go:117] "RemoveContainer" containerID="95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072356    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173"} err="failed to get container status \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": rpc error: code = NotFound desc = could not find container \"95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173\": container with ID starting with 95468a31279e9226f8a650098e48a9dae30b1fa1b790d2176e7dc76184022173 not found: ID does not exist"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072386    2580 scope.go:117] "RemoveContainer" containerID="29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072642    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533"} err="failed to get container status \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": rpc error: code = NotFound desc = could not find container \"29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533\": container with ID starting with 29ea09cd7897484ad3f8f4518e0eb94c14da457771368d1dc77d8a0e5a0b6533 not found: ID does not exist"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072661    2580 scope.go:117] "RemoveContainer" containerID="c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072909    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa"} err="failed to get container status \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": rpc error: code = NotFound desc = could not find container \"c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa\": container with ID starting with c5f8be881add23d9b72a97ed6f9514fe5d4ee8a38d6a513b694646bc4f0678aa not found: ID does not exist"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.072929    2580 scope.go:117] "RemoveContainer" containerID="dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.073203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5"} err="failed to get container status \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": rpc error: code = NotFound desc = could not find container \"dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5\": container with ID starting with dafad7dd63da64f5743fe44baea84e9c9abcfbb29c844bf3a7ea03d0c5cc3bb5 not found: ID does not exist"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.073222    2580 scope.go:117] "RemoveContainer" containerID="a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.073505    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64"} err="failed to get container status \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": rpc error: code = NotFound desc = could not find container \"a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64\": container with ID starting with a988546de166bec95caae8d5c2aed6d0bc54063b69828d4cef29292312550c64 not found: ID does not exist"
Jul 10 18:32:22.073939 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.073524    2580 scope.go:117] "RemoveContainer" containerID="dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074058    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074119    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074113    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b00r0usjn9b91\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074439    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976"} err="failed to get container status \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": rpc error: code = NotFound desc = could not find container \"dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976\": container with ID starting with dea1d3a222666f8384cf0bb89ff4ae984db519fd9f987e71e9d91fb49152c976 not found: ID does not exist"
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 18:32:22.074571 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 18:32:22.074911 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 18:32:22.074911 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.074855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lx5hq\""
Jul 10 18:32:22.075690 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.075670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 18:32:22.077064 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.076516    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 18:32:22.077145 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.077075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 18:32:22.083980 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.083958    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 18:32:22.084698 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.084494    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 18:32:22.087067 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.087019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:22.131576 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.131892 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.131892 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.131892 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.131892 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkml\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-kube-api-access-hqkml\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132104 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132104 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.131959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132205 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132242 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132242 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132314 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132314 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132314 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132430 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132430 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132430 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132573 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132573 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132573 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.132715 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.132652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233542 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.233984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkml\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-kube-api-access-hqkml\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234354 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234780 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.234905 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.234881    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.236667 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.236641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.236947 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.236717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.236947 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.236834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.236947 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.236846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237151 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237593 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237853 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.237853 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.237841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a64da33-ae67-482f-8126-9cba94c2d4a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.238057 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.238010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.238456 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.238428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.239022 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.238993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a64da33-ae67-482f-8126-9cba94c2d4a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.239557 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.239540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-config\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.239694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.239676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.239730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.239695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a64da33-ae67-482f-8126-9cba94c2d4a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.245093 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.245069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkml\" (UniqueName: \"kubernetes.io/projected/8a64da33-ae67-482f-8126-9cba94c2d4a6-kube-api-access-hqkml\") pod \"prometheus-k8s-0\" (UID: \"8a64da33-ae67-482f-8126-9cba94c2d4a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.386155 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.386117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:22.520193 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:22.520168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 18:32:22.521943 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:32:22.521917    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a64da33_ae67_482f_8126_9cba94c2d4a6.slice/crio-d2a1668ca9f9ce715c69a46c5aa35cd45c523800a9b3aa0c7e1e0dd377b38e13 WatchSource:0}: Error finding container d2a1668ca9f9ce715c69a46c5aa35cd45c523800a9b3aa0c7e1e0dd377b38e13: Status 404 returned error can't find the container with id d2a1668ca9f9ce715c69a46c5aa35cd45c523800a9b3aa0c7e1e0dd377b38e13
Jul 10 18:32:23.013744 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:23.013714    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a64da33-ae67-482f-8126-9cba94c2d4a6" containerID="0ee25fe3ff08217c84c0b403a592519f5965709fedb4b59b551eb5fbebf04a98" exitCode=0
Jul 10 18:32:23.014165 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:23.013770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerDied","Data":"0ee25fe3ff08217c84c0b403a592519f5965709fedb4b59b551eb5fbebf04a98"}
Jul 10 18:32:23.014165 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:23.013820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"d2a1668ca9f9ce715c69a46c5aa35cd45c523800a9b3aa0c7e1e0dd377b38e13"}
Jul 10 18:32:23.253390 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:23.253358    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b341df83-298a-4cfa-b956-39293f6465f9" path="/var/lib/kubelet/pods/b341df83-298a-4cfa-b956-39293f6465f9/volumes"
Jul 10 18:32:24.022138 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"c1f7c10cad459be2f220fbc7896a18ae3f347c91d618f7de1a005b99f3f611e0"}
Jul 10 18:32:24.022523 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"69a35bf5111c7d55150d632c19a47af5156e58bc6095cc722e098d9ec5a729bf"}
Jul 10 18:32:24.022523 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"537cff16ac3dd272a6a6244801cbb1d50630d1d898ce172c9f336d004721e8c3"}
Jul 10 18:32:24.022523 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"5609a526747fd378cf265ddc2b42db63afe18d35d785325da34abb807c3b7e72"}
Jul 10 18:32:24.022523 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"653143557b53d28d86abc1cb89d45bd23dfcb77fff45a8593895759f824c51d8"}
Jul 10 18:32:24.022523 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.022375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a64da33-ae67-482f-8126-9cba94c2d4a6","Type":"ContainerStarted","Data":"ddb9da7bbae8bd7580de8422958c51bf85e5892a49fe31a5ee0754b1dd913d95"}
Jul 10 18:32:24.049172 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:24.049105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.03184847 podStartE2EDuration="2.049082469s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.233999ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:24.047142602 +0000 UTC m=+143.430470855" watchObservedRunningTime="2026-07-10 18:32:24.049082469 +0000 UTC m=+143.432410724"
Jul 10 18:32:27.386646 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:27.386610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:32:30.439172 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:30.439137    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:32:55.459694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.459654    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cd9f6b5dd-q9mcv" podUID="d2d1f935-976f-4437-996f-767c18582c07" containerName="console" containerID="cri-o://2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb" gracePeriod=15
Jul 10 18:32:55.708327 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.708302    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:32:55.749003 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.748906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749003 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.748948    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749003 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.748971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749003 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749035    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749146    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qw7t\" (UniqueName: \"kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t\") pod \"d2d1f935-976f-4437-996f-767c18582c07\" (UID: \"d2d1f935-976f-4437-996f-767c18582c07\") "
Jul 10 18:32:55.749534 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749487    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config" (OuterVolumeSpecName: "console-config") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:55.749534 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749493    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:55.749534 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:55.749710 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.749617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:32:55.751289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.751257    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t" (OuterVolumeSpecName: "kube-api-access-7qw7t") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "kube-api-access-7qw7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:32:55.751397 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.751324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:55.751438 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.751403    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2d1f935-976f-4437-996f-767c18582c07" (UID: "d2d1f935-976f-4437-996f-767c18582c07"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:32:55.850205 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850164    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-trusted-ca-bundle\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850205 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850195    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qw7t\" (UniqueName: \"kubernetes.io/projected/d2d1f935-976f-4437-996f-767c18582c07-kube-api-access-7qw7t\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850205 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850204    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-oauth-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850205 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850213    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-oauth-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850471 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850223    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-console-config\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850471 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850232    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1f935-976f-4437-996f-767c18582c07-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:55.850471 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:55.850240    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d1f935-976f-4437-996f-767c18582c07-console-serving-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:32:56.166055 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.166002    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2d1f935-976f-4437-996f-767c18582c07" containerID="2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb" exitCode=0
Jul 10 18:32:56.166055 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.166055    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f6b5dd-q9mcv"
Jul 10 18:32:56.166261 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.166094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f6b5dd-q9mcv" event={"ID":"d2d1f935-976f-4437-996f-767c18582c07","Type":"ContainerDied","Data":"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"}
Jul 10 18:32:56.166261 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.166146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f6b5dd-q9mcv" event={"ID":"d2d1f935-976f-4437-996f-767c18582c07","Type":"ContainerDied","Data":"54ec3b49109e5c5bb4bdf8fad35e790655c9ed8272c0ef93b38441c8fb77d80a"}
Jul 10 18:32:56.166261 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.166168    2580 scope.go:117] "RemoveContainer" containerID="2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"
Jul 10 18:32:56.175193 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.175173    2580 scope.go:117] "RemoveContainer" containerID="2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"
Jul 10 18:32:56.175466 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:32:56.175449    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb\": container with ID starting with 2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb not found: ID does not exist" containerID="2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"
Jul 10 18:32:56.175510 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.175476    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb"} err="failed to get container status \"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb\": rpc error: code = NotFound desc = could not find container \"2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb\": container with ID starting with 2979186d5699135906b1cf9e5d06b95537b58aff5f538c6429460238594338cb not found: ID does not exist"
Jul 10 18:32:56.185857 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.185830    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:32:56.192568 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:56.190751    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd9f6b5dd-q9mcv"]
Jul 10 18:32:57.250808 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:32:57.250775    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d1f935-976f-4437-996f-767c18582c07" path="/var/lib/kubelet/pods/d2d1f935-976f-4437-996f-767c18582c07/volumes"
Jul 10 18:33:22.387019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:33:22.386961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:33:22.403052 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:33:22.403007    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:33:23.292258 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:33:23.292229    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 18:35:01.090507 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:35:01.090470    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:35:01.091367 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:35:01.091341    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:35:01.094438 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:35:01.094419    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 18:36:23.653343 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.653301    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b8nnw"]
Jul 10 18:36:23.653762 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.653720    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d1f935-976f-4437-996f-767c18582c07" containerName="console"
Jul 10 18:36:23.653762 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.653739    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d1f935-976f-4437-996f-767c18582c07" containerName="console"
Jul 10 18:36:23.653833 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.653795    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d1f935-976f-4437-996f-767c18582c07" containerName="console"
Jul 10 18:36:23.656648 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.656631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.658997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.658975    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 18:36:23.659240 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.659225    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b6kh6\""
Jul 10 18:36:23.659725 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.659706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 18:36:23.671685 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.671662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b8nnw"]
Jul 10 18:36:23.707890 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.707856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjm2q\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-kube-api-access-kjm2q\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.708118 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.707895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.809145 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.809109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjm2q\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-kube-api-access-kjm2q\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.809145 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.809149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.821544 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.821510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.821544 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.821542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjm2q\" (UniqueName: \"kubernetes.io/projected/c96de905-12b3-441a-8ac2-381cdf399016-kube-api-access-kjm2q\") pod \"cert-manager-webhook-6486ffd997-b8nnw\" (UID: \"c96de905-12b3-441a-8ac2-381cdf399016\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:23.979444 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:23.979357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:24.121095 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:24.121061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b8nnw"]
Jul 10 18:36:24.124235 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:36:24.124205    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc96de905_12b3_441a_8ac2_381cdf399016.slice/crio-fdba5e19360dda1eb4d287fa1b64b803d930ae0b52a75a8ea02ce1a57dc04f70 WatchSource:0}: Error finding container fdba5e19360dda1eb4d287fa1b64b803d930ae0b52a75a8ea02ce1a57dc04f70: Status 404 returned error can't find the container with id fdba5e19360dda1eb4d287fa1b64b803d930ae0b52a75a8ea02ce1a57dc04f70
Jul 10 18:36:24.126645 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:24.126627    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:36:25.007228 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.007191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw" event={"ID":"c96de905-12b3-441a-8ac2-381cdf399016","Type":"ContainerStarted","Data":"fdba5e19360dda1eb4d287fa1b64b803d930ae0b52a75a8ea02ce1a57dc04f70"}
Jul 10 18:36:25.891281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.891239    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"]
Jul 10 18:36:25.894812 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.894698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:25.897251 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.897226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wfm76\""
Jul 10 18:36:25.905998 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.905975    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"]
Jul 10 18:36:25.928316 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.928243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:25.928517 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:25.928327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srcd\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-kube-api-access-9srcd\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:26.029316 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:26.029285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:26.029791 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:26.029336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srcd\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-kube-api-access-9srcd\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:26.038841 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:26.038809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:26.039389 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:26.039361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srcd\" (UniqueName: \"kubernetes.io/projected/8abf5086-90c5-4eda-a91a-d2888221b18a-kube-api-access-9srcd\") pod \"cert-manager-cainjector-559cdd8c87-sth6m\" (UID: \"8abf5086-90c5-4eda-a91a-d2888221b18a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:26.206970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:26.206868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"
Jul 10 18:36:27.908904 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:27.908877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sth6m"]
Jul 10 18:36:27.912302 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:36:27.912278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8abf5086_90c5_4eda_a91a_d2888221b18a.slice/crio-51b503bda48a37d433ee67ccf8ac2040f473885ca7bedf092e1b85bebf4c28ba WatchSource:0}: Error finding container 51b503bda48a37d433ee67ccf8ac2040f473885ca7bedf092e1b85bebf4c28ba: Status 404 returned error can't find the container with id 51b503bda48a37d433ee67ccf8ac2040f473885ca7bedf092e1b85bebf4c28ba
Jul 10 18:36:28.026864 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.026822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw" event={"ID":"c96de905-12b3-441a-8ac2-381cdf399016","Type":"ContainerStarted","Data":"eb0eea102c75a9e7a6c4965c6d9d22405e52a7d56fc1352a3e03894a70813b35"}
Jul 10 18:36:28.027077 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.026917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:36:28.028427 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.028401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m" event={"ID":"8abf5086-90c5-4eda-a91a-d2888221b18a","Type":"ContainerStarted","Data":"cd1b1c17d68812b68ae6069de5943c36bd1c43a30d6622426e6c6aff9139a6fa"}
Jul 10 18:36:28.028517 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.028436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m" event={"ID":"8abf5086-90c5-4eda-a91a-d2888221b18a","Type":"ContainerStarted","Data":"51b503bda48a37d433ee67ccf8ac2040f473885ca7bedf092e1b85bebf4c28ba"}
Jul 10 18:36:28.048578 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.048523    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw" podStartSLOduration=1.327071073 podStartE2EDuration="5.048505538s" totalImagesPullingTime="3.721434465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:28.047197075 +0000 UTC m=+387.430525328" watchObservedRunningTime="2026-07-10 18:36:28.048505538 +0000 UTC m=+387.431833791"
Jul 10 18:36:28.062971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:28.062926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sth6m" podStartSLOduration=3.062909629 podStartE2EDuration="3.062909629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:28.061982469 +0000 UTC m=+387.445310724" watchObservedRunningTime="2026-07-10 18:36:28.062909629 +0000 UTC m=+387.446237884"
Jul 10 18:36:34.036395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:36:34.036360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b8nnw"
Jul 10 18:37:00.448949 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.448912    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"]
Jul 10 18:37:00.452276 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.452257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.454677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.454657    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 18:37:00.455864 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.455835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 18:37:00.455981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.455845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 18:37:00.455981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.455888    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:37:00.455981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.455845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fsjsn\""
Jul 10 18:37:00.455981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.455863    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 18:37:00.463226 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.463205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"]
Jul 10 18:37:00.541050 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.540998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.541245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.541089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.541245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.541110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a30a818-f3bd-4145-9238-900c8c89fb53-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.541245 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.541228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5grv\" (UniqueName: \"kubernetes.io/projected/9a30a818-f3bd-4145-9238-900c8c89fb53-kube-api-access-v5grv\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.642421 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.642371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5grv\" (UniqueName: \"kubernetes.io/projected/9a30a818-f3bd-4145-9238-900c8c89fb53-kube-api-access-v5grv\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.642421 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.642420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.642689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.642480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.642689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.642501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a30a818-f3bd-4145-9238-900c8c89fb53-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.643258 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.643227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a30a818-f3bd-4145-9238-900c8c89fb53-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.645022 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.644991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.645022 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.645018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a30a818-f3bd-4145-9238-900c8c89fb53-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.652083 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.652059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5grv\" (UniqueName: \"kubernetes.io/projected/9a30a818-f3bd-4145-9238-900c8c89fb53-kube-api-access-v5grv\") pod \"lws-controller-manager-6c6cfb7f55-nqdpf\" (UID: \"9a30a818-f3bd-4145-9238-900c8c89fb53\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.761813 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.761722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:00.910125 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:00.910091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"]
Jul 10 18:37:00.913235 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:37:00.913205    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a30a818_f3bd_4145_9238_900c8c89fb53.slice/crio-fb489c6ef933ae5e94d959a4d27c2500c421b071d5fd58dccf5c64bd6ef11a42 WatchSource:0}: Error finding container fb489c6ef933ae5e94d959a4d27c2500c421b071d5fd58dccf5c64bd6ef11a42: Status 404 returned error can't find the container with id fb489c6ef933ae5e94d959a4d27c2500c421b071d5fd58dccf5c64bd6ef11a42
Jul 10 18:37:01.001988 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.001956    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"]
Jul 10 18:37:01.006424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.006406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.011709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.011677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 18:37:01.011709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.011701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 18:37:01.012403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.012323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 18:37:01.012403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.012332    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 18:37:01.016341 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.016319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4lmws\""
Jul 10 18:37:01.044876 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.044844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv7tx\" (UniqueName: \"kubernetes.io/projected/05840596-8691-47cf-b3e0-df2992840467-kube-api-access-dv7tx\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.045019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.044887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.045019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.044954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.045019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.044997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.045156 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.045035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.060139 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.060107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"]
Jul 10 18:37:01.145970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.145939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.145970 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.145976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.146268 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.146000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.146268 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.146032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.146268 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.146096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv7tx\" (UniqueName: \"kubernetes.io/projected/05840596-8691-47cf-b3e0-df2992840467-kube-api-access-dv7tx\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.146425 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.146411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.148190 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.148168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05840596-8691-47cf-b3e0-df2992840467-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.148690 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.148671    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 18:37:01.154811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.154794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 18:37:01.158673 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.158646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.158767 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.158693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05840596-8691-47cf-b3e0-df2992840467-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.165720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.165656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 18:37:01.170282 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.170255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf" event={"ID":"9a30a818-f3bd-4145-9238-900c8c89fb53","Type":"ContainerStarted","Data":"fb489c6ef933ae5e94d959a4d27c2500c421b071d5fd58dccf5c64bd6ef11a42"}
Jul 10 18:37:01.176730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.176709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv7tx\" (UniqueName: \"kubernetes.io/projected/05840596-8691-47cf-b3e0-df2992840467-kube-api-access-dv7tx\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v\" (UID: \"05840596-8691-47cf-b3e0-df2992840467\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.319426 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.319401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4lmws\""
Jul 10 18:37:01.328355 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.328332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:01.462251 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:01.462228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"]
Jul 10 18:37:01.465020 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:37:01.464989    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05840596_8691_47cf_b3e0_df2992840467.slice/crio-bd606d524efeb75c990cbd92a45008247acc37f759dcee4227fd6466224f8de3 WatchSource:0}: Error finding container bd606d524efeb75c990cbd92a45008247acc37f759dcee4227fd6466224f8de3: Status 404 returned error can't find the container with id bd606d524efeb75c990cbd92a45008247acc37f759dcee4227fd6466224f8de3
Jul 10 18:37:02.177056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:02.176995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v" event={"ID":"05840596-8691-47cf-b3e0-df2992840467","Type":"ContainerStarted","Data":"bd606d524efeb75c990cbd92a45008247acc37f759dcee4227fd6466224f8de3"}
Jul 10 18:37:06.197546 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:06.197509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf" event={"ID":"9a30a818-f3bd-4145-9238-900c8c89fb53","Type":"ContainerStarted","Data":"6103fef7b985597c9af307db10e03914bdc369a7adfe5c2f6aeb6640a3a50b22"}
Jul 10 18:37:06.197985 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:06.197574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:06.199151 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:06.199125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v" event={"ID":"05840596-8691-47cf-b3e0-df2992840467","Type":"ContainerStarted","Data":"884a2dd61184708924ade6cf699a02a3a3ed25ccf77e432b59d5f4ff42218b7f"}
Jul 10 18:37:06.215160 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:06.215111    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf" podStartSLOduration=1.927187305 podStartE2EDuration="6.215094982s" totalImagesPullingTime="4.287907677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:06.213281843 +0000 UTC m=+425.596610111" watchObservedRunningTime="2026-07-10 18:37:06.215094982 +0000 UTC m=+425.598423236"
Jul 10 18:37:07.204526 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:07.204487    2580 generic.go:356] "Generic (PLEG): container finished" podID="05840596-8691-47cf-b3e0-df2992840467" containerID="884a2dd61184708924ade6cf699a02a3a3ed25ccf77e432b59d5f4ff42218b7f" exitCode=0
Jul 10 18:37:07.204965 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:07.204581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v" event={"ID":"05840596-8691-47cf-b3e0-df2992840467","Type":"ContainerDied","Data":"884a2dd61184708924ade6cf699a02a3a3ed25ccf77e432b59d5f4ff42218b7f"}
Jul 10 18:37:08.211436 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:08.211397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v" event={"ID":"05840596-8691-47cf-b3e0-df2992840467","Type":"ContainerStarted","Data":"c81a12a919dc79aac298d4f521b82bcdd024ab137c516043b3ef65f983d2352d"}
Jul 10 18:37:08.211923 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:08.211509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:08.233396 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:08.233328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v" podStartSLOduration=3.020369847 podStartE2EDuration="8.23330672s" totalImagesPullingTime="4.129086135s" totalInitContainerRuntime="1.083850738s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:08.231514657 +0000 UTC m=+427.614842908" watchObservedRunningTime="2026-07-10 18:37:08.23330672 +0000 UTC m=+427.616634976"
Jul 10 18:37:17.206668 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:17.206635    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-nqdpf"
Jul 10 18:37:19.218630 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:19.218600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v"
Jul 10 18:37:21.789995 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.789963    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d88546674-qvn8m"]
Jul 10 18:37:21.894604 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.894568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d88546674-qvn8m"]
Jul 10 18:37:21.894737 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.894719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:21.897295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.897255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 18:37:21.897295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.897265    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 18:37:21.897295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.897266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 18:37:21.897665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.897651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 18:37:21.897718 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:21.897684    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5nns2\""
Jul 10 18:37:22.035928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.035896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tmp\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.036157 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.035968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tls-certs\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.036157 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.035993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v524l\" (UniqueName: \"kubernetes.io/projected/5b319cd1-506c-47e7-9dea-0bba65aff8d4-kube-api-access-v524l\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.136894 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.136805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tmp\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.136894 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.136889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tls-certs\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.137095 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.136926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v524l\" (UniqueName: \"kubernetes.io/projected/5b319cd1-506c-47e7-9dea-0bba65aff8d4-kube-api-access-v524l\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.139311 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.139285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tmp\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.139443 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.139424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b319cd1-506c-47e7-9dea-0bba65aff8d4-tls-certs\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.145793 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.145765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v524l\" (UniqueName: \"kubernetes.io/projected/5b319cd1-506c-47e7-9dea-0bba65aff8d4-kube-api-access-v524l\") pod \"kube-auth-proxy-d88546674-qvn8m\" (UID: \"5b319cd1-506c-47e7-9dea-0bba65aff8d4\") " pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.207017 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.206988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m"
Jul 10 18:37:22.370489 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:22.370456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d88546674-qvn8m"]
Jul 10 18:37:22.374860 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:37:22.374827    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b319cd1_506c_47e7_9dea_0bba65aff8d4.slice/crio-7ec727b02d7bbc30e181a0cfe6893bb39f053ada47013e3706e0109730ab85c6 WatchSource:0}: Error finding container 7ec727b02d7bbc30e181a0cfe6893bb39f053ada47013e3706e0109730ab85c6: Status 404 returned error can't find the container with id 7ec727b02d7bbc30e181a0cfe6893bb39f053ada47013e3706e0109730ab85c6
Jul 10 18:37:23.286837 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:23.286804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m" event={"ID":"5b319cd1-506c-47e7-9dea-0bba65aff8d4","Type":"ContainerStarted","Data":"7ec727b02d7bbc30e181a0cfe6893bb39f053ada47013e3706e0109730ab85c6"}
Jul 10 18:37:25.298085 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:25.298030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m" event={"ID":"5b319cd1-506c-47e7-9dea-0bba65aff8d4","Type":"ContainerStarted","Data":"7980c4f393f6e81582dd0c82dfffb5e8f6fdf9b4d25db4bf33b3f434290bbaf3"}
Jul 10 18:37:25.315669 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:37:25.315613    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d88546674-qvn8m" podStartSLOduration=1.4983462379999999 podStartE2EDuration="4.315594231s" totalImagesPullingTime="2.817247993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:25.312921496 +0000 UTC m=+444.696249752" watchObservedRunningTime="2026-07-10 18:37:25.315594231 +0000 UTC m=+444.698922485"
Jul 10 18:39:03.454597 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.454514    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"]
Jul 10 18:39:03.457265 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.457249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.459736 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.459713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:39:03.459873 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.459805    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x9lc4\""
Jul 10 18:39:03.460094 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.460077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:39:03.469169 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.469147    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"]
Jul 10 18:39:03.555473 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.555439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.555473 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.555476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5bf\" (UniqueName: \"kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.656744 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.656710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.656928 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.656754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5bf\" (UniqueName: \"kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.657135 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.657112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.684452 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.684422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5bf\" (UniqueName: \"kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.767357 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.767278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:03.900577 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:03.900546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"]
Jul 10 18:39:03.903817 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:39:03.903789    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16bf734e_7087_4ccb_89d1_8559b84f3622.slice/crio-2ab993269065bdbc0fefee321cd4f7dfbac77d763d253165ffd9d33cb82d6e19 WatchSource:0}: Error finding container 2ab993269065bdbc0fefee321cd4f7dfbac77d763d253165ffd9d33cb82d6e19: Status 404 returned error can't find the container with id 2ab993269065bdbc0fefee321cd4f7dfbac77d763d253165ffd9d33cb82d6e19
Jul 10 18:39:04.745386 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:04.745353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt" event={"ID":"16bf734e-7087-4ccb-89d1-8559b84f3622","Type":"ContainerStarted","Data":"2ab993269065bdbc0fefee321cd4f7dfbac77d763d253165ffd9d33cb82d6e19"}
Jul 10 18:39:10.777365 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:10.777328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt" event={"ID":"16bf734e-7087-4ccb-89d1-8559b84f3622","Type":"ContainerStarted","Data":"2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33"}
Jul 10 18:39:10.777834 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:10.777476    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:10.799688 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:10.799636    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt" podStartSLOduration=1.651580314 podStartE2EDuration="7.799620382s" totalImagesPullingTime="6.148040068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:10.798397789 +0000 UTC m=+550.181726047" watchObservedRunningTime="2026-07-10 18:39:10.799620382 +0000 UTC m=+550.182948635"
Jul 10 18:39:21.784023 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:21.783987    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.415612 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.415583    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"]
Jul 10 18:39:23.416020 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.415770    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" containerName="manager" containerID="cri-o://2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33" gracePeriod=2
Jul 10 18:39:23.426625 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.426574    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"]
Jul 10 18:39:23.436229 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.436183    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"16bf734e-7087-4ccb-89d1-8559b84f3622\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.436712 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.436685    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:23.437253 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.437230    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" containerName="manager"
Jul 10 18:39:23.437336 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.437258    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" containerName="manager"
Jul 10 18:39:23.437395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.437382    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" containerName="manager"
Jul 10 18:39:23.441299 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.441282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.456856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.456836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:23.486534 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.486502    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.531216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.531184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.531377 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.531227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsfc\" (UniqueName: \"kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.631779 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.631732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.631929 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.631804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsfc\" (UniqueName: \"kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.632152 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.632131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.644005 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.643980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsfc\" (UniqueName: \"kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cglg\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.661535 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.661515    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.663341 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.663318    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.732785 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.732715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume\") pod \"16bf734e-7087-4ccb-89d1-8559b84f3622\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") "
Jul 10 18:39:23.732785 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.732758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs5bf\" (UniqueName: \"kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf\") pod \"16bf734e-7087-4ccb-89d1-8559b84f3622\" (UID: \"16bf734e-7087-4ccb-89d1-8559b84f3622\") "
Jul 10 18:39:23.733234 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.733214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16bf734e-7087-4ccb-89d1-8559b84f3622" (UID: "16bf734e-7087-4ccb-89d1-8559b84f3622"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:23.734885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.734862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf" (OuterVolumeSpecName: "kube-api-access-qs5bf") pod "16bf734e-7087-4ccb-89d1-8559b84f3622" (UID: "16bf734e-7087-4ccb-89d1-8559b84f3622"). InnerVolumeSpecName "kube-api-access-qs5bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:39:23.793266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.793230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:23.833531 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.833485    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16bf734e-7087-4ccb-89d1-8559b84f3622-extensions-socket-volume\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:39:23.833689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.833539    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs5bf\" (UniqueName: \"kubernetes.io/projected/16bf734e-7087-4ccb-89d1-8559b84f3622-kube-api-access-qs5bf\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:39:23.838448 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.838420    2580 generic.go:356] "Generic (PLEG): container finished" podID="16bf734e-7087-4ccb-89d1-8559b84f3622" containerID="2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33" exitCode=0
Jul 10 18:39:23.838583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.838465    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.838583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.838526    2580 scope.go:117] "RemoveContainer" containerID="2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33"
Jul 10 18:39:23.840698 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.840657    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.851641 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.851554    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:23.851717 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.851699    2580 scope.go:117] "RemoveContainer" containerID="2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33"
Jul 10 18:39:23.852025 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:23.852009    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33\": container with ID starting with 2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33 not found: ID does not exist" containerID="2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33"
Jul 10 18:39:23.852106 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.852033    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33"} err="failed to get container status \"2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33\": rpc error: code = NotFound desc = could not find container \"2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33\": container with ID starting with 2c3f590ff713ca465c27e02d624c1483631690cbd82aaf5a1a3dedc974c05b33 not found: ID does not exist"
Jul 10 18:39:23.932350 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:23.932181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:23.934866 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:39:23.934837    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094537a1_6ae9_40ea_bdd4_729ae0d886ed.slice/crio-cf1bc2d4fd78cddbf260cfd130dd2b5931a1152277b9560821bea6165aa8c0ec WatchSource:0}: Error finding container cf1bc2d4fd78cddbf260cfd130dd2b5931a1152277b9560821bea6165aa8c0ec: Status 404 returned error can't find the container with id cf1bc2d4fd78cddbf260cfd130dd2b5931a1152277b9560821bea6165aa8c0ec
Jul 10 18:39:24.845804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:24.845766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" event={"ID":"094537a1-6ae9-40ea-bdd4-729ae0d886ed","Type":"ContainerStarted","Data":"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"}
Jul 10 18:39:24.846211 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:24.845822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" event={"ID":"094537a1-6ae9-40ea-bdd4-729ae0d886ed","Type":"ContainerStarted","Data":"cf1bc2d4fd78cddbf260cfd130dd2b5931a1152277b9560821bea6165aa8c0ec"}
Jul 10 18:39:24.846211 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:24.845850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:24.847630 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:24.847609    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g5vpt\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g5vpt"
Jul 10 18:39:24.872643 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:24.872601    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" podStartSLOduration=1.872585862 podStartE2EDuration="1.872585862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:24.870208834 +0000 UTC m=+564.253537080" watchObservedRunningTime="2026-07-10 18:39:24.872585862 +0000 UTC m=+564.255914192"
Jul 10 18:39:25.251505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:25.251426    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16bf734e-7087-4ccb-89d1-8559b84f3622" path="/var/lib/kubelet/pods/16bf734e-7087-4ccb-89d1-8559b84f3622/volumes"
Jul 10 18:39:35.853481 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:35.853443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:51.396860 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.396820    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:51.397281 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.397066    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" podUID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" containerName="manager" containerID="cri-o://7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57" gracePeriod=10
Jul 10 18:39:51.653887 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.653821    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:51.795784 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.795750    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwsfc\" (UniqueName: \"kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc\") pod \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") "
Jul 10 18:39:51.795966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.795856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume\") pod \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\" (UID: \"094537a1-6ae9-40ea-bdd4-729ae0d886ed\") "
Jul 10 18:39:51.796291 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.796265    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "094537a1-6ae9-40ea-bdd4-729ae0d886ed" (UID: "094537a1-6ae9-40ea-bdd4-729ae0d886ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:51.797891 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.797867    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc" (OuterVolumeSpecName: "kube-api-access-lwsfc") pod "094537a1-6ae9-40ea-bdd4-729ae0d886ed" (UID: "094537a1-6ae9-40ea-bdd4-729ae0d886ed"). InnerVolumeSpecName "kube-api-access-lwsfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:39:51.896507 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.896466    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/094537a1-6ae9-40ea-bdd4-729ae0d886ed-extensions-socket-volume\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:39:51.896678 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.896523    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwsfc\" (UniqueName: \"kubernetes.io/projected/094537a1-6ae9-40ea-bdd4-729ae0d886ed-kube-api-access-lwsfc\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:39:51.971629 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.971550    2580 generic.go:356] "Generic (PLEG): container finished" podID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" containerID="7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57" exitCode=0
Jul 10 18:39:51.971629 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.971582    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"
Jul 10 18:39:51.971828 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.971630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" event={"ID":"094537a1-6ae9-40ea-bdd4-729ae0d886ed","Type":"ContainerDied","Data":"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"}
Jul 10 18:39:51.971828 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.971678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg" event={"ID":"094537a1-6ae9-40ea-bdd4-729ae0d886ed","Type":"ContainerDied","Data":"cf1bc2d4fd78cddbf260cfd130dd2b5931a1152277b9560821bea6165aa8c0ec"}
Jul 10 18:39:51.971828 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.971700    2580 scope.go:117] "RemoveContainer" containerID="7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"
Jul 10 18:39:51.980811 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.980785    2580 scope.go:117] "RemoveContainer" containerID="7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"
Jul 10 18:39:51.981078 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:39:51.981052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57\": container with ID starting with 7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57 not found: ID does not exist" containerID="7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"
Jul 10 18:39:51.981128 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.981089    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57"} err="failed to get container status \"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57\": rpc error: code = NotFound desc = could not find container \"7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57\": container with ID starting with 7e1938126e6309f9106d90c81df380547355cf332a63d3cdbede234acb957a57 not found: ID does not exist"
Jul 10 18:39:51.995318 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.995289    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:51.997052 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:51.997022    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cglg"]
Jul 10 18:39:53.252285 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:39:53.252252    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" path="/var/lib/kubelet/pods/094537a1-6ae9-40ea-bdd4-729ae0d886ed/volumes"
Jul 10 18:40:01.120999 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:01.120966    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:40:01.121469 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:01.121074    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:40:10.706495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.706461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:10.707001 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.706863    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" containerName="manager"
Jul 10 18:40:10.707001 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.706875    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" containerName="manager"
Jul 10 18:40:10.707001 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.706933    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="094537a1-6ae9-40ea-bdd4-729ae0d886ed" containerName="manager"
Jul 10 18:40:10.711489 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.711469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.713908 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.713881    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:40:10.714076 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.713881    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 18:40:10.714445 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.714430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:40:10.714528 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.714454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8jfkp\""
Jul 10 18:40:10.720658 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.720633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:10.761886 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.761840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.761886 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.761886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slhc2\" (UniqueName: \"kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.804309 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.804272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:10.862804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.862767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.862804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.862804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slhc2\" (UniqueName: \"kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.863477 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.863453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:10.870699 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:10.870673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slhc2\" (UniqueName: \"kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2\") pod \"limitador-limitador-64c94fd64f-gzdb6\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:11.023001 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.022920    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:11.157846 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.157701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:11.160655 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:11.160622    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d553dd_0683_4a2d_9c4f_b2f0a19ecca8.slice/crio-6cd5f1a9a5808182364d812a576b912dc2d4a852c12f588bc09dddc974d9d900 WatchSource:0}: Error finding container 6cd5f1a9a5808182364d812a576b912dc2d4a852c12f588bc09dddc974d9d900: Status 404 returned error can't find the container with id 6cd5f1a9a5808182364d812a576b912dc2d4a852c12f588bc09dddc974d9d900
Jul 10 18:40:11.499476 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.499441    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:11.504027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.504011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:11.506212 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.506190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4xtxx\""
Jul 10 18:40:11.509805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.509782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:11.569474 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.569436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnz92\" (UniqueName: \"kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92\") pod \"authorino-58cd955675-g5f8t\" (UID: \"04e32dbb-1125-4689-8216-254fbbdbbf8c\") " pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:11.670484 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.670443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnz92\" (UniqueName: \"kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92\") pod \"authorino-58cd955675-g5f8t\" (UID: \"04e32dbb-1125-4689-8216-254fbbdbbf8c\") " pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:11.678491 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.678457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnz92\" (UniqueName: \"kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92\") pod \"authorino-58cd955675-g5f8t\" (UID: \"04e32dbb-1125-4689-8216-254fbbdbbf8c\") " pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:11.766851 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.766763    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:11.770827 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.770803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:11.782395 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.782367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:11.814527 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.814490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:11.872303 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.872273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvhnk\" (UniqueName: \"kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk\") pod \"authorino-75d556bd77-8wvwj\" (UID: \"f1627730-9a04-4217-bf42-c687ef101a9d\") " pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:11.951319 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.951295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:11.953258 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:11.953231    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04e32dbb_1125_4689_8216_254fbbdbbf8c.slice/crio-114c16475b987c2fc91fe01bd2777f19f3d649c09a9b230ce6d9c8a84131232a WatchSource:0}: Error finding container 114c16475b987c2fc91fe01bd2777f19f3d649c09a9b230ce6d9c8a84131232a: Status 404 returned error can't find the container with id 114c16475b987c2fc91fe01bd2777f19f3d649c09a9b230ce6d9c8a84131232a
Jul 10 18:40:11.973332 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.973303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvhnk\" (UniqueName: \"kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk\") pod \"authorino-75d556bd77-8wvwj\" (UID: \"f1627730-9a04-4217-bf42-c687ef101a9d\") " pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:11.981897 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:11.981875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvhnk\" (UniqueName: \"kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk\") pod \"authorino-75d556bd77-8wvwj\" (UID: \"f1627730-9a04-4217-bf42-c687ef101a9d\") " pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:12.080095 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:12.080025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:12.080305 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:12.080275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" event={"ID":"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8","Type":"ContainerStarted","Data":"6cd5f1a9a5808182364d812a576b912dc2d4a852c12f588bc09dddc974d9d900"}
Jul 10 18:40:12.081843 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:12.081807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g5f8t" event={"ID":"04e32dbb-1125-4689-8216-254fbbdbbf8c","Type":"ContainerStarted","Data":"114c16475b987c2fc91fe01bd2777f19f3d649c09a9b230ce6d9c8a84131232a"}
Jul 10 18:40:12.277973 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:12.277939    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:12.284660 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:12.284614    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1627730_9a04_4217_bf42_c687ef101a9d.slice/crio-008b6180bf43ef03594e554ea64856407d2a53899ecb4f5ca929cc997977ee5d WatchSource:0}: Error finding container 008b6180bf43ef03594e554ea64856407d2a53899ecb4f5ca929cc997977ee5d: Status 404 returned error can't find the container with id 008b6180bf43ef03594e554ea64856407d2a53899ecb4f5ca929cc997977ee5d
Jul 10 18:40:13.100554 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:13.100507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8wvwj" event={"ID":"f1627730-9a04-4217-bf42-c687ef101a9d","Type":"ContainerStarted","Data":"008b6180bf43ef03594e554ea64856407d2a53899ecb4f5ca929cc997977ee5d"}
Jul 10 18:40:17.128385 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.128329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8wvwj" event={"ID":"f1627730-9a04-4217-bf42-c687ef101a9d","Type":"ContainerStarted","Data":"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"}
Jul 10 18:40:17.129947 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.129917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" event={"ID":"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8","Type":"ContainerStarted","Data":"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"}
Jul 10 18:40:17.130121 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.129973    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:17.131466 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.131441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g5f8t" event={"ID":"04e32dbb-1125-4689-8216-254fbbdbbf8c","Type":"ContainerStarted","Data":"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"}
Jul 10 18:40:17.142821 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.142742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8wvwj" podStartSLOduration=1.787437631 podStartE2EDuration="6.142723307s" totalImagesPullingTime="4.355285676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:17.141845635 +0000 UTC m=+616.525173890" watchObservedRunningTime="2026-07-10 18:40:17.142723307 +0000 UTC m=+616.526051562"
Jul 10 18:40:17.159567 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.159501    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" podStartSLOduration=1.6693176570000001 podStartE2EDuration="7.159478795s" totalImagesPullingTime="5.490161138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:17.156580794 +0000 UTC m=+616.539909049" watchObservedRunningTime="2026-07-10 18:40:17.159478795 +0000 UTC m=+616.542807054"
Jul 10 18:40:17.171096 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.170842    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g5f8t" podStartSLOduration=1.483523966 podStartE2EDuration="6.170821709s" totalImagesPullingTime="4.687297743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:17.170463254 +0000 UTC m=+616.553791509" watchObservedRunningTime="2026-07-10 18:40:17.170821709 +0000 UTC m=+616.554149963"
Jul 10 18:40:17.177991 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:17.177961    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:19.141207 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:19.141168    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g5f8t" podUID="04e32dbb-1125-4689-8216-254fbbdbbf8c" containerName="authorino" containerID="cri-o://671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a" gracePeriod=30
Jul 10 18:40:19.402335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:19.402270    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:19.452840 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:19.452798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnz92\" (UniqueName: \"kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92\") pod \"04e32dbb-1125-4689-8216-254fbbdbbf8c\" (UID: \"04e32dbb-1125-4689-8216-254fbbdbbf8c\") "
Jul 10 18:40:19.454874 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:19.454846    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92" (OuterVolumeSpecName: "kube-api-access-cnz92") pod "04e32dbb-1125-4689-8216-254fbbdbbf8c" (UID: "04e32dbb-1125-4689-8216-254fbbdbbf8c"). InnerVolumeSpecName "kube-api-access-cnz92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:19.554481 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:19.554425    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnz92\" (UniqueName: \"kubernetes.io/projected/04e32dbb-1125-4689-8216-254fbbdbbf8c-kube-api-access-cnz92\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:20.147207 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.147173    2580 generic.go:356] "Generic (PLEG): container finished" podID="04e32dbb-1125-4689-8216-254fbbdbbf8c" containerID="671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a" exitCode=0
Jul 10 18:40:20.147665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.147219    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g5f8t"
Jul 10 18:40:20.147665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.147264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g5f8t" event={"ID":"04e32dbb-1125-4689-8216-254fbbdbbf8c","Type":"ContainerDied","Data":"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"}
Jul 10 18:40:20.147665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.147322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g5f8t" event={"ID":"04e32dbb-1125-4689-8216-254fbbdbbf8c","Type":"ContainerDied","Data":"114c16475b987c2fc91fe01bd2777f19f3d649c09a9b230ce6d9c8a84131232a"}
Jul 10 18:40:20.147665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.147347    2580 scope.go:117] "RemoveContainer" containerID="671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"
Jul 10 18:40:20.155903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.155886    2580 scope.go:117] "RemoveContainer" containerID="671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"
Jul 10 18:40:20.156208 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:20.156189    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a\": container with ID starting with 671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a not found: ID does not exist" containerID="671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"
Jul 10 18:40:20.156255 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.156220    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a"} err="failed to get container status \"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a\": rpc error: code = NotFound desc = could not find container \"671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a\": container with ID starting with 671e2794493033fbb9f57bc32db3e1028866c86049369825db6b13e769ac116a not found: ID does not exist"
Jul 10 18:40:20.167138 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.167109    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:20.172949 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:20.172920    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g5f8t"]
Jul 10 18:40:21.251774 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:21.251731    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e32dbb-1125-4689-8216-254fbbdbbf8c" path="/var/lib/kubelet/pods/04e32dbb-1125-4689-8216-254fbbdbbf8c/volumes"
Jul 10 18:40:26.570357 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:26.570275    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:26.570818 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:26.570518    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" podUID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" containerName="limitador" containerID="cri-o://8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1" gracePeriod=30
Jul 10 18:40:26.571292 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:26.571273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:27.121838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.121815    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:27.181735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.181637    2580 generic.go:356] "Generic (PLEG): container finished" podID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" containerID="8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1" exitCode=0
Jul 10 18:40:27.181735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.181686    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"
Jul 10 18:40:27.181735 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.181720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" event={"ID":"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8","Type":"ContainerDied","Data":"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"}
Jul 10 18:40:27.181971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.181776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzdb6" event={"ID":"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8","Type":"ContainerDied","Data":"6cd5f1a9a5808182364d812a576b912dc2d4a852c12f588bc09dddc974d9d900"}
Jul 10 18:40:27.181971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.181801    2580 scope.go:117] "RemoveContainer" containerID="8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"
Jul 10 18:40:27.189967 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.189948    2580 scope.go:117] "RemoveContainer" containerID="8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"
Jul 10 18:40:27.190280 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:27.190258    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1\": container with ID starting with 8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1 not found: ID does not exist" containerID="8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"
Jul 10 18:40:27.190363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.190294    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1"} err="failed to get container status \"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1\": rpc error: code = NotFound desc = could not find container \"8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1\": container with ID starting with 8845652bb7605d408020478b2f0a73be782d1f585871158e3b4fc2f30dea7fc1 not found: ID does not exist"
Jul 10 18:40:27.230537 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.230499    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slhc2\" (UniqueName: \"kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2\") pod \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") "
Jul 10 18:40:27.230730 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.230547    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file\") pod \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\" (UID: \"50d553dd-0683-4a2d-9c4f-b2f0a19ecca8\") "
Jul 10 18:40:27.230933 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.230908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file" (OuterVolumeSpecName: "config-file") pod "50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" (UID: "50d553dd-0683-4a2d-9c4f-b2f0a19ecca8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:40:27.232640 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.232619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2" (OuterVolumeSpecName: "kube-api-access-slhc2") pod "50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" (UID: "50d553dd-0683-4a2d-9c4f-b2f0a19ecca8"). InnerVolumeSpecName "kube-api-access-slhc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:27.331474 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.331416    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slhc2\" (UniqueName: \"kubernetes.io/projected/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-kube-api-access-slhc2\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:27.331474 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.331469    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8-config-file\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:27.497288 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.497179    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:27.498706 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:27.498683    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzdb6"]
Jul 10 18:40:29.257728 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:29.257686    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" path="/var/lib/kubelet/pods/50d553dd-0683-4a2d-9c4f-b2f0a19ecca8/volumes"
Jul 10 18:40:31.006169 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"]
Jul 10 18:40:31.006543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006489    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" containerName="limitador"
Jul 10 18:40:31.006543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006499    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" containerName="limitador"
Jul 10 18:40:31.006543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006522    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e32dbb-1125-4689-8216-254fbbdbbf8c" containerName="authorino"
Jul 10 18:40:31.006543 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006528    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e32dbb-1125-4689-8216-254fbbdbbf8c" containerName="authorino"
Jul 10 18:40:31.006674 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006580    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d553dd-0683-4a2d-9c4f-b2f0a19ecca8" containerName="limitador"
Jul 10 18:40:31.006674 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.006591    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e32dbb-1125-4689-8216-254fbbdbbf8c" containerName="authorino"
Jul 10 18:40:31.010936 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.010916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.013204 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.013180    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 18:40:31.013820 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.013799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 18:40:31.013913 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.013803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-k2zbh\""
Jul 10 18:40:31.013913 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.013868    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 18:40:31.017485 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.017460    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"]
Jul 10 18:40:31.164954 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.164911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ad73afd-db57-49dd-9ea1-14ef98f54a19-data\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.165177 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.165035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrpl\" (UniqueName: \"kubernetes.io/projected/8ad73afd-db57-49dd-9ea1-14ef98f54a19-kube-api-access-psrpl\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.266337 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.266247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrpl\" (UniqueName: \"kubernetes.io/projected/8ad73afd-db57-49dd-9ea1-14ef98f54a19-kube-api-access-psrpl\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.266337 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.266301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ad73afd-db57-49dd-9ea1-14ef98f54a19-data\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.266659 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.266642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ad73afd-db57-49dd-9ea1-14ef98f54a19-data\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.274236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.274207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrpl\" (UniqueName: \"kubernetes.io/projected/8ad73afd-db57-49dd-9ea1-14ef98f54a19-kube-api-access-psrpl\") pod \"postgres-69fb4594cf-r78sp\" (UID: \"8ad73afd-db57-49dd-9ea1-14ef98f54a19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.322107 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.322077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:31.456208 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:31.456180    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"]
Jul 10 18:40:31.458578 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:31.458555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad73afd_db57_49dd_9ea1_14ef98f54a19.slice/crio-5fdb4b9a9ca0970de787e6604da7c7773bc7ed55cabd34a8234a59a3afb6ebef WatchSource:0}: Error finding container 5fdb4b9a9ca0970de787e6604da7c7773bc7ed55cabd34a8234a59a3afb6ebef: Status 404 returned error can't find the container with id 5fdb4b9a9ca0970de787e6604da7c7773bc7ed55cabd34a8234a59a3afb6ebef
Jul 10 18:40:32.207940 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:32.207906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp" event={"ID":"8ad73afd-db57-49dd-9ea1-14ef98f54a19","Type":"ContainerStarted","Data":"5fdb4b9a9ca0970de787e6604da7c7773bc7ed55cabd34a8234a59a3afb6ebef"}
Jul 10 18:40:37.236368 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:37.236325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp" event={"ID":"8ad73afd-db57-49dd-9ea1-14ef98f54a19","Type":"ContainerStarted","Data":"020f3af3308cef6f1406bdee1faa3b86e28ae4d36629d6f9dc77f8a7bdb5bf13"}
Jul 10 18:40:37.236788 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:37.236395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:37.252178 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:37.252110    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp" podStartSLOduration=2.326218775 podStartE2EDuration="7.252089395s" totalImagesPullingTime="4.92587062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:37.251277504 +0000 UTC m=+636.634605772" watchObservedRunningTime="2026-07-10 18:40:37.252089395 +0000 UTC m=+636.635417649"
Jul 10 18:40:43.273973 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.273939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r78sp"
Jul 10 18:40:43.792200 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.792164    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:43.798415 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.798390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:43.802289 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.802262    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:43.878531 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.878488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8rv\" (UniqueName: \"kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv\") pod \"authorino-5d4b67c446-8nsbj\" (UID: \"a052096d-2b14-4c88-899d-499d83017eb8\") " pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:43.979116 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.979074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8rv\" (UniqueName: \"kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv\") pod \"authorino-5d4b67c446-8nsbj\" (UID: \"a052096d-2b14-4c88-899d-499d83017eb8\") " pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:43.986986 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:43.986953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8rv\" (UniqueName: \"kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv\") pod \"authorino-5d4b67c446-8nsbj\" (UID: \"a052096d-2b14-4c88-899d-499d83017eb8\") " pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:44.014089 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.014061    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:44.014364 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.014350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:44.037749 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.037717    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:44.043287 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.043221    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:44.047190 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.047158    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:44.079898 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.079869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbfd\" (UniqueName: \"kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd\") pod \"authorino-6bc544bd87-hxrb2\" (UID: \"ad59697d-2b10-4adc-92d1-914bde10da1f\") " pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:44.156416 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.156388    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:44.158984 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:44.158952    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda052096d_2b14_4c88_899d_499d83017eb8.slice/crio-d4d53fcd537de487fe199861d3684da3cbc2d4eb31409e1f88ab056fa7254879 WatchSource:0}: Error finding container d4d53fcd537de487fe199861d3684da3cbc2d4eb31409e1f88ab056fa7254879: Status 404 returned error can't find the container with id d4d53fcd537de487fe199861d3684da3cbc2d4eb31409e1f88ab056fa7254879
Jul 10 18:40:44.181260 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.181223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbfd\" (UniqueName: \"kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd\") pod \"authorino-6bc544bd87-hxrb2\" (UID: \"ad59697d-2b10-4adc-92d1-914bde10da1f\") " pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:44.200421 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.200387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbfd\" (UniqueName: \"kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd\") pod \"authorino-6bc544bd87-hxrb2\" (UID: \"ad59697d-2b10-4adc-92d1-914bde10da1f\") " pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:44.249232 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.249199    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:44.249483 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.249471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:44.278813 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.278787    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:40:44.284104 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.284074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" event={"ID":"a052096d-2b14-4c88-899d-499d83017eb8","Type":"ContainerStarted","Data":"d4d53fcd537de487fe199861d3684da3cbc2d4eb31409e1f88ab056fa7254879"}
Jul 10 18:40:44.284269 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.284179    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.286210 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.286185    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 18:40:44.289721 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.289694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:40:44.383849 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.383810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxd9\" (UniqueName: \"kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.384018 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.383913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.390444 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.390411    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:44.393549 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:44.393519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad59697d_2b10_4adc_92d1_914bde10da1f.slice/crio-5b796e0399c23bef53aa929cde694c159336df28d48a2c1edcdb80944a610e4c WatchSource:0}: Error finding container 5b796e0399c23bef53aa929cde694c159336df28d48a2c1edcdb80944a610e4c: Status 404 returned error can't find the container with id 5b796e0399c23bef53aa929cde694c159336df28d48a2c1edcdb80944a610e4c
Jul 10 18:40:44.485386 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.485349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxd9\" (UniqueName: \"kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.485559 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.485409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.487851 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.487821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.492842 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.492816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxd9\" (UniqueName: \"kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9\") pod \"authorino-799ff7cc8c-57llr\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") " pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.596236 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.596118    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:40:44.739981 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:44.739945    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:40:44.743318 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:44.743289    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a79d033_54c0_42bd_99ee_9be0047b771a.slice/crio-0d41e79ee618f8bbcd06bfd75bdcb6b2fc15fab72a39ad734f32d8c22a9a2361 WatchSource:0}: Error finding container 0d41e79ee618f8bbcd06bfd75bdcb6b2fc15fab72a39ad734f32d8c22a9a2361: Status 404 returned error can't find the container with id 0d41e79ee618f8bbcd06bfd75bdcb6b2fc15fab72a39ad734f32d8c22a9a2361
Jul 10 18:40:45.287121 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.287082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799ff7cc8c-57llr" event={"ID":"7a79d033-54c0-42bd-99ee-9be0047b771a","Type":"ContainerStarted","Data":"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"}
Jul 10 18:40:45.287769 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.287130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799ff7cc8c-57llr" event={"ID":"7a79d033-54c0-42bd-99ee-9be0047b771a","Type":"ContainerStarted","Data":"0d41e79ee618f8bbcd06bfd75bdcb6b2fc15fab72a39ad734f32d8c22a9a2361"}
Jul 10 18:40:45.288650 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.288621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" event={"ID":"a052096d-2b14-4c88-899d-499d83017eb8","Type":"ContainerStarted","Data":"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"}
Jul 10 18:40:45.288776 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.288669    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" podUID="a052096d-2b14-4c88-899d-499d83017eb8" containerName="authorino" containerID="cri-o://4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7" gracePeriod=30
Jul 10 18:40:45.289827 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.289790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" event={"ID":"ad59697d-2b10-4adc-92d1-914bde10da1f","Type":"ContainerStarted","Data":"5b796e0399c23bef53aa929cde694c159336df28d48a2c1edcdb80944a610e4c"}
Jul 10 18:40:45.306424 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.306374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-799ff7cc8c-57llr" podStartSLOduration=0.949508865 podStartE2EDuration="1.306357482s" totalImagesPullingTime="356.848617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:45.304122316 +0000 UTC m=+644.687450570" watchObservedRunningTime="2026-07-10 18:40:45.306357482 +0000 UTC m=+644.689685736"
Jul 10 18:40:45.329803 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.329748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" podStartSLOduration=1.861126745 podStartE2EDuration="2.329731811s" totalImagesPullingTime="468.605066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:45.32789356 +0000 UTC m=+644.711221813" watchObservedRunningTime="2026-07-10 18:40:45.329731811 +0000 UTC m=+644.713060084"
Jul 10 18:40:45.344908 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.344867    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:45.345186 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.345145    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8wvwj" podUID="f1627730-9a04-4217-bf42-c687ef101a9d" containerName="authorino" containerID="cri-o://6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f" gracePeriod=30
Jul 10 18:40:45.611022 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.610998    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:45.618017 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.617994    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:45.697183 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.697144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf8rv\" (UniqueName: \"kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv\") pod \"a052096d-2b14-4c88-899d-499d83017eb8\" (UID: \"a052096d-2b14-4c88-899d-499d83017eb8\") "
Jul 10 18:40:45.697388 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.697193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvhnk\" (UniqueName: \"kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk\") pod \"f1627730-9a04-4217-bf42-c687ef101a9d\" (UID: \"f1627730-9a04-4217-bf42-c687ef101a9d\") "
Jul 10 18:40:45.699363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.699328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv" (OuterVolumeSpecName: "kube-api-access-nf8rv") pod "a052096d-2b14-4c88-899d-499d83017eb8" (UID: "a052096d-2b14-4c88-899d-499d83017eb8"). InnerVolumeSpecName "kube-api-access-nf8rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:45.699363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.699359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk" (OuterVolumeSpecName: "kube-api-access-cvhnk") pod "f1627730-9a04-4217-bf42-c687ef101a9d" (UID: "f1627730-9a04-4217-bf42-c687ef101a9d"). InnerVolumeSpecName "kube-api-access-cvhnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:45.798009 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.797969    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf8rv\" (UniqueName: \"kubernetes.io/projected/a052096d-2b14-4c88-899d-499d83017eb8-kube-api-access-nf8rv\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:45.798009 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:45.798002    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvhnk\" (UniqueName: \"kubernetes.io/projected/f1627730-9a04-4217-bf42-c687ef101a9d-kube-api-access-cvhnk\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:46.297517 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.297475    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1627730-9a04-4217-bf42-c687ef101a9d" containerID="6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f" exitCode=0
Jul 10 18:40:46.298031 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.297526    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8wvwj"
Jul 10 18:40:46.298031 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.297560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8wvwj" event={"ID":"f1627730-9a04-4217-bf42-c687ef101a9d","Type":"ContainerDied","Data":"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"}
Jul 10 18:40:46.298031 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.297618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8wvwj" event={"ID":"f1627730-9a04-4217-bf42-c687ef101a9d","Type":"ContainerDied","Data":"008b6180bf43ef03594e554ea64856407d2a53899ecb4f5ca929cc997977ee5d"}
Jul 10 18:40:46.298031 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.297637    2580 scope.go:117] "RemoveContainer" containerID="6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"
Jul 10 18:40:46.299201 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.299174    2580 generic.go:356] "Generic (PLEG): container finished" podID="a052096d-2b14-4c88-899d-499d83017eb8" containerID="4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7" exitCode=0
Jul 10 18:40:46.299304 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.299217    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8nsbj"
Jul 10 18:40:46.299304 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.299264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" event={"ID":"a052096d-2b14-4c88-899d-499d83017eb8","Type":"ContainerDied","Data":"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"}
Jul 10 18:40:46.299417 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.299308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8nsbj" event={"ID":"a052096d-2b14-4c88-899d-499d83017eb8","Type":"ContainerDied","Data":"d4d53fcd537de487fe199861d3684da3cbc2d4eb31409e1f88ab056fa7254879"}
Jul 10 18:40:46.301091 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.301034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" event={"ID":"ad59697d-2b10-4adc-92d1-914bde10da1f","Type":"ContainerStarted","Data":"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"}
Jul 10 18:40:46.301213 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.301127    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" podUID="ad59697d-2b10-4adc-92d1-914bde10da1f" containerName="authorino" containerID="cri-o://29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412" gracePeriod=30
Jul 10 18:40:46.307468 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.307397    2580 scope.go:117] "RemoveContainer" containerID="6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"
Jul 10 18:40:46.307783 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:46.307746    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f\": container with ID starting with 6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f not found: ID does not exist" containerID="6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"
Jul 10 18:40:46.307838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.307796    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f"} err="failed to get container status \"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f\": rpc error: code = NotFound desc = could not find container \"6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f\": container with ID starting with 6aecbcce81c82c1e5cb4a75687c4ee92859ef5d71c2841e45222108308203a9f not found: ID does not exist"
Jul 10 18:40:46.307838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.307820    2580 scope.go:117] "RemoveContainer" containerID="4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"
Jul 10 18:40:46.318033 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.317977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" podStartSLOduration=1.333344169 podStartE2EDuration="2.317959299s" totalImagesPullingTime="984.61513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:46.316011208 +0000 UTC m=+645.699339463" watchObservedRunningTime="2026-07-10 18:40:46.317959299 +0000 UTC m=+645.701287552"
Jul 10 18:40:46.322549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.322527    2580 scope.go:117] "RemoveContainer" containerID="4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"
Jul 10 18:40:46.322889 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:46.322867    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7\": container with ID starting with 4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7 not found: ID does not exist" containerID="4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"
Jul 10 18:40:46.322968 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.322896    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7"} err="failed to get container status \"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7\": rpc error: code = NotFound desc = could not find container \"4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7\": container with ID starting with 4d2dce574e3e091008f9bb61db921b6f3cf3b1d85563798ba3c0d627150dcff7 not found: ID does not exist"
Jul 10 18:40:46.332566 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.332535    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:46.336088 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.336032    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8nsbj"]
Jul 10 18:40:46.344504 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.344478    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:46.347824 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.347801    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8wvwj"]
Jul 10 18:40:46.553971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.553896    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:46.605959 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.605930    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdbfd\" (UniqueName: \"kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd\") pod \"ad59697d-2b10-4adc-92d1-914bde10da1f\" (UID: \"ad59697d-2b10-4adc-92d1-914bde10da1f\") "
Jul 10 18:40:46.607961 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.607939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd" (OuterVolumeSpecName: "kube-api-access-pdbfd") pod "ad59697d-2b10-4adc-92d1-914bde10da1f" (UID: "ad59697d-2b10-4adc-92d1-914bde10da1f"). InnerVolumeSpecName "kube-api-access-pdbfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:46.707446 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:46.707410    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdbfd\" (UniqueName: \"kubernetes.io/projected/ad59697d-2b10-4adc-92d1-914bde10da1f-kube-api-access-pdbfd\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:40:47.252403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.252367    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a052096d-2b14-4c88-899d-499d83017eb8" path="/var/lib/kubelet/pods/a052096d-2b14-4c88-899d-499d83017eb8/volumes"
Jul 10 18:40:47.252785 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.252765    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1627730-9a04-4217-bf42-c687ef101a9d" path="/var/lib/kubelet/pods/f1627730-9a04-4217-bf42-c687ef101a9d/volumes"
Jul 10 18:40:47.308572 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.308540    2580 generic.go:356] "Generic (PLEG): container finished" podID="ad59697d-2b10-4adc-92d1-914bde10da1f" containerID="29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412" exitCode=0
Jul 10 18:40:47.309077 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.308584    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc544bd87-hxrb2"
Jul 10 18:40:47.309077 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.308627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" event={"ID":"ad59697d-2b10-4adc-92d1-914bde10da1f","Type":"ContainerDied","Data":"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"}
Jul 10 18:40:47.309077 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.308668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc544bd87-hxrb2" event={"ID":"ad59697d-2b10-4adc-92d1-914bde10da1f","Type":"ContainerDied","Data":"5b796e0399c23bef53aa929cde694c159336df28d48a2c1edcdb80944a610e4c"}
Jul 10 18:40:47.309077 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.308696    2580 scope.go:117] "RemoveContainer" containerID="29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"
Jul 10 18:40:47.320556 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.320537    2580 scope.go:117] "RemoveContainer" containerID="29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"
Jul 10 18:40:47.321004 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:47.320981    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412\": container with ID starting with 29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412 not found: ID does not exist" containerID="29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"
Jul 10 18:40:47.321098 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.321013    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412"} err="failed to get container status \"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412\": rpc error: code = NotFound desc = could not find container \"29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412\": container with ID starting with 29e2a98cf48edb2280cb266292c5722ea9e2240fd8eec005599fbcc20fe0a412 not found: ID does not exist"
Jul 10 18:40:47.323420 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.323398    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:47.327203 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:47.327182    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bc544bd87-hxrb2"]
Jul 10 18:40:49.251490 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.251446    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad59697d-2b10-4adc-92d1-914bde10da1f" path="/var/lib/kubelet/pods/ad59697d-2b10-4adc-92d1-914bde10da1f/volumes"
Jul 10 18:40:49.480392 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480354    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:40:49.480726 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480714    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a052096d-2b14-4c88-899d-499d83017eb8" containerName="authorino"
Jul 10 18:40:49.480786 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480727    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a052096d-2b14-4c88-899d-499d83017eb8" containerName="authorino"
Jul 10 18:40:49.480786 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480746    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1627730-9a04-4217-bf42-c687ef101a9d" containerName="authorino"
Jul 10 18:40:49.480786 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480753    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1627730-9a04-4217-bf42-c687ef101a9d" containerName="authorino"
Jul 10 18:40:49.480786 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480765    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad59697d-2b10-4adc-92d1-914bde10da1f" containerName="authorino"
Jul 10 18:40:49.480786 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480771    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad59697d-2b10-4adc-92d1-914bde10da1f" containerName="authorino"
Jul 10 18:40:49.481072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480832    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1627730-9a04-4217-bf42-c687ef101a9d" containerName="authorino"
Jul 10 18:40:49.481072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480844    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad59697d-2b10-4adc-92d1-914bde10da1f" containerName="authorino"
Jul 10 18:40:49.481072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.480851    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a052096d-2b14-4c88-899d-499d83017eb8" containerName="authorino"
Jul 10 18:40:49.562930 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.562889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:40:49.563141 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.563008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.565284 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.565260    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:40:49.565284 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.565277    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:40:49.565477 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.565356    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv4v6\""
Jul 10 18:40:49.635564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.635524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.635777 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.635595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hfv\" (UniqueName: \"kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.640742 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.640713    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:40:49.662306 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.662273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:40:49.662461 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.662394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:49.736561 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.736529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.736561 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.736572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:49.736799 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.736611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pqv\" (UniqueName: \"kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:49.736799 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.736695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hfv\" (UniqueName: \"kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.736799 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:49.736744    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 10 18:40:49.736921 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:49.736820    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert podName:685d27d2-ad31-475e-8c1c-b3ff1bd1ad91 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:50.236796928 +0000 UTC m=+649.620125173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert") pod "maas-controller-8689d58985-h8h49" (UID: "685d27d2-ad31-475e-8c1c-b3ff1bd1ad91") : secret "maas-controller-webhook-cert" not found
Jul 10 18:40:49.747460 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.747425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hfv\" (UniqueName: \"kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:49.837450 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.837348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:49.837450 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.837408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pqv\" (UniqueName: \"kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:49.837655 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:49.837509    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 10 18:40:49.837655 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:40:49.837597    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert podName:0bc37e2f-7a56-4f61-9960-fe24b96e7d7c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:50.337579245 +0000 UTC m=+649.720907477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert") pod "maas-controller-865c7ddc8b-hcpkp" (UID: "0bc37e2f-7a56-4f61-9960-fe24b96e7d7c") : secret "maas-controller-webhook-cert" not found
Jul 10 18:40:49.846255 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:49.846223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pqv\" (UniqueName: \"kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:50.242187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.242093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:50.244600 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.244576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") pod \"maas-controller-8689d58985-h8h49\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") " pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:50.343084 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.343015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:50.345457 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.345435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") pod \"maas-controller-865c7ddc8b-hcpkp\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") " pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:50.473622 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.473584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:50.572798 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.572761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:50.666096 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.666070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:40:50.668610 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:50.668579    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685d27d2_ad31_475e_8c1c_b3ff1bd1ad91.slice/crio-00fddafaba2423228d8ce0117bbf7c7b696ce739a026e7356532aa1bc0a3fb8a WatchSource:0}: Error finding container 00fddafaba2423228d8ce0117bbf7c7b696ce739a026e7356532aa1bc0a3fb8a: Status 404 returned error can't find the container with id 00fddafaba2423228d8ce0117bbf7c7b696ce739a026e7356532aa1bc0a3fb8a
Jul 10 18:40:50.723589 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:50.723561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:40:50.726153 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:40:50.726110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc37e2f_7a56_4f61_9960_fe24b96e7d7c.slice/crio-93217643ecfe21bf0fb7563c3a36ffbed2aa9b35d88210e34859ed7efbe946fe WatchSource:0}: Error finding container 93217643ecfe21bf0fb7563c3a36ffbed2aa9b35d88210e34859ed7efbe946fe: Status 404 returned error can't find the container with id 93217643ecfe21bf0fb7563c3a36ffbed2aa9b35d88210e34859ed7efbe946fe
Jul 10 18:40:51.332728 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:51.332689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" event={"ID":"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c","Type":"ContainerStarted","Data":"93217643ecfe21bf0fb7563c3a36ffbed2aa9b35d88210e34859ed7efbe946fe"}
Jul 10 18:40:51.333817 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:51.333791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689d58985-h8h49" event={"ID":"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91","Type":"ContainerStarted","Data":"00fddafaba2423228d8ce0117bbf7c7b696ce739a026e7356532aa1bc0a3fb8a"}
Jul 10 18:40:54.352149 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.352100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" event={"ID":"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c","Type":"ContainerStarted","Data":"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"}
Jul 10 18:40:54.352666 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.352240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:40:54.353627 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.353605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689d58985-h8h49" event={"ID":"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91","Type":"ContainerStarted","Data":"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"}
Jul 10 18:40:54.353733 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.353697    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:40:54.369752 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.369696    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" podStartSLOduration=2.428744065 podStartE2EDuration="5.369679268s" totalImagesPullingTime="2.940935203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:54.368259941 +0000 UTC m=+653.751588196" watchObservedRunningTime="2026-07-10 18:40:54.369679268 +0000 UTC m=+653.753007500"
Jul 10 18:40:54.386088 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:40:54.386012    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8689d58985-h8h49" podStartSLOduration=2.396403162 podStartE2EDuration="5.385994618s" totalImagesPullingTime="2.989591456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:54.385138038 +0000 UTC m=+653.768466306" watchObservedRunningTime="2026-07-10 18:40:54.385994618 +0000 UTC m=+653.769322871"
Jul 10 18:41:05.364107 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.364075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:41:05.364600 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.364162    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:41:05.434963 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.434927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:41:05.435262 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.435224    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8689d58985-h8h49" podUID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" containerName="manager" containerID="cri-o://cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44" gracePeriod=30
Jul 10 18:41:05.682560 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.682528    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:41:05.794467 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.794429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") pod \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") "
Jul 10 18:41:05.794672 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.794490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4hfv\" (UniqueName: \"kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv\") pod \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\" (UID: \"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91\") "
Jul 10 18:41:05.796709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.796680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" (UID: "685d27d2-ad31-475e-8c1c-b3ff1bd1ad91"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:41:05.796709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.796698    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv" (OuterVolumeSpecName: "kube-api-access-r4hfv") pod "685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" (UID: "685d27d2-ad31-475e-8c1c-b3ff1bd1ad91"). InnerVolumeSpecName "kube-api-access-r4hfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:05.895896 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.895846    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-webhook-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:41:05.895896 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:05.895889    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4hfv\" (UniqueName: \"kubernetes.io/projected/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91-kube-api-access-r4hfv\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:41:06.420653 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.420614    2580 generic.go:356] "Generic (PLEG): container finished" podID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" containerID="cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44" exitCode=0
Jul 10 18:41:06.421158 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.420671    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689d58985-h8h49"
Jul 10 18:41:06.421158 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.420699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689d58985-h8h49" event={"ID":"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91","Type":"ContainerDied","Data":"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"}
Jul 10 18:41:06.421158 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.420776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689d58985-h8h49" event={"ID":"685d27d2-ad31-475e-8c1c-b3ff1bd1ad91","Type":"ContainerDied","Data":"00fddafaba2423228d8ce0117bbf7c7b696ce739a026e7356532aa1bc0a3fb8a"}
Jul 10 18:41:06.421158 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.420799    2580 scope.go:117] "RemoveContainer" containerID="cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"
Jul 10 18:41:06.429787 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.429765    2580 scope.go:117] "RemoveContainer" containerID="cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"
Jul 10 18:41:06.430114 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:41:06.430090    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44\": container with ID starting with cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44 not found: ID does not exist" containerID="cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"
Jul 10 18:41:06.430169 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.430126    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44"} err="failed to get container status \"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44\": rpc error: code = NotFound desc = could not find container \"cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44\": container with ID starting with cb474428fe35364a9105504c7dd2efa44b4218833ca2be814d27d81278862f44 not found: ID does not exist"
Jul 10 18:41:06.441079 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.441031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:41:06.445518 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:06.445491    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8689d58985-h8h49"]
Jul 10 18:41:07.252271 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:07.252239    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" path="/var/lib/kubelet/pods/685d27d2-ad31-475e-8c1c-b3ff1bd1ad91/volumes"
Jul 10 18:41:27.062060 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.062016    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"]
Jul 10 18:41:27.062525 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.062423    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" containerName="manager"
Jul 10 18:41:27.062525 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.062434    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" containerName="manager"
Jul 10 18:41:27.062525 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.062514    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="685d27d2-ad31-475e-8c1c-b3ff1bd1ad91" containerName="manager"
Jul 10 18:41:27.065534 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.065512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.067532 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.067507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 18:41:27.067649 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.067570    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jnmd7\""
Jul 10 18:41:27.075146 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.075117    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"]
Jul 10 18:41:27.199073 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.199012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a66781-6d3e-41ac-a03f-10053485e43d-openshift-service-ca\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.199266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.199098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgvv7\" (UniqueName: \"kubernetes.io/projected/f6a66781-6d3e-41ac-a03f-10053485e43d-kube-api-access-rgvv7\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.199266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.199142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.300381 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.300343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a66781-6d3e-41ac-a03f-10053485e43d-openshift-service-ca\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.300569 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.300395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgvv7\" (UniqueName: \"kubernetes.io/projected/f6a66781-6d3e-41ac-a03f-10053485e43d-kube-api-access-rgvv7\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.300569 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.300453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.300716 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:41:27.300584    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 18:41:27.300716 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:41:27.300670    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls podName:f6a66781-6d3e-41ac-a03f-10053485e43d nodeName:}" failed. No retries permitted until 2026-07-10 18:41:27.800647708 +0000 UTC m=+687.183975941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls") pod "maas-api-5647dfbb5b-c4kvz" (UID: "f6a66781-6d3e-41ac-a03f-10053485e43d") : secret "maas-api-serving-cert" not found
Jul 10 18:41:27.301113 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.301093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a66781-6d3e-41ac-a03f-10053485e43d-openshift-service-ca\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.310335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.310285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgvv7\" (UniqueName: \"kubernetes.io/projected/f6a66781-6d3e-41ac-a03f-10053485e43d-kube-api-access-rgvv7\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.612377 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.612341    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4jnqd"]
Jul 10 18:41:27.615696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.615675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.619155 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.619125    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 18:41:27.619295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.619132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fnshk\""
Jul 10 18:41:27.629186 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.629155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4jnqd"]
Jul 10 18:41:27.704751 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.704715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bjw4\" (UniqueName: \"kubernetes.io/projected/4495eed0-5f28-496f-a227-405cf70aa10f-kube-api-access-9bjw4\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.704941 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.704767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495eed0-5f28-496f-a227-405cf70aa10f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.806032 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.805982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bjw4\" (UniqueName: \"kubernetes.io/projected/4495eed0-5f28-496f-a227-405cf70aa10f-kube-api-access-9bjw4\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.806292 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.806092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495eed0-5f28-496f-a227-405cf70aa10f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.806292 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.806178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.806856 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.806831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4495eed0-5f28-496f-a227-405cf70aa10f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.808603 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.808579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a66781-6d3e-41ac-a03f-10053485e43d-maas-api-tls\") pod \"maas-api-5647dfbb5b-c4kvz\" (UID: \"f6a66781-6d3e-41ac-a03f-10053485e43d\") " pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:27.813578 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.813554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bjw4\" (UniqueName: \"kubernetes.io/projected/4495eed0-5f28-496f-a227-405cf70aa10f-kube-api-access-9bjw4\") pod \"payload-processing-58f86c7798-4jnqd\" (UID: \"4495eed0-5f28-496f-a227-405cf70aa10f\") " pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.927456 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.927346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:27.976966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:27.976927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:28.075489 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:28.075461    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4jnqd"]
Jul 10 18:41:28.079501 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:41:28.079465    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4495eed0_5f28_496f_a227_405cf70aa10f.slice/crio-7ee4897b4afbc523cedac05f091b9a8c7b9f901c37d15be13903122cd89f171b WatchSource:0}: Error finding container 7ee4897b4afbc523cedac05f091b9a8c7b9f901c37d15be13903122cd89f171b: Status 404 returned error can't find the container with id 7ee4897b4afbc523cedac05f091b9a8c7b9f901c37d15be13903122cd89f171b
Jul 10 18:41:28.081854 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:28.081822    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:41:28.125587 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:28.125558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"]
Jul 10 18:41:28.128292 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:41:28.128259    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a66781_6d3e_41ac_a03f_10053485e43d.slice/crio-edcb8c34c7a9aa872a48bf7bb61ba88e89119961f84ae7e7a15b95cfbe280bde WatchSource:0}: Error finding container edcb8c34c7a9aa872a48bf7bb61ba88e89119961f84ae7e7a15b95cfbe280bde: Status 404 returned error can't find the container with id edcb8c34c7a9aa872a48bf7bb61ba88e89119961f84ae7e7a15b95cfbe280bde
Jul 10 18:41:28.523097 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:28.523053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz" event={"ID":"f6a66781-6d3e-41ac-a03f-10053485e43d","Type":"ContainerStarted","Data":"edcb8c34c7a9aa872a48bf7bb61ba88e89119961f84ae7e7a15b95cfbe280bde"}
Jul 10 18:41:28.524249 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:28.524225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd" event={"ID":"4495eed0-5f28-496f-a227-405cf70aa10f","Type":"ContainerStarted","Data":"7ee4897b4afbc523cedac05f091b9a8c7b9f901c37d15be13903122cd89f171b"}
Jul 10 18:41:30.537765 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.537724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz" event={"ID":"f6a66781-6d3e-41ac-a03f-10053485e43d","Type":"ContainerStarted","Data":"2350faed8f362aad5e80ee75b74973de1460b3e3024279a212ba6c0bc8207b61"}
Jul 10 18:41:30.538254 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.537801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:30.539309 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.539288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd" event={"ID":"4495eed0-5f28-496f-a227-405cf70aa10f","Type":"ContainerStarted","Data":"cf0ab4dbd93d49b953b75a1dc8fe2608359f18721b47c9d082ac7742481a8317"}
Jul 10 18:41:30.546019 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.540416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:41:30.560541 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.560490    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz" podStartSLOduration=1.897758925 podStartE2EDuration="3.560476118s" totalImagesPullingTime="1.662717193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:30.5590058 +0000 UTC m=+689.942334053" watchObservedRunningTime="2026-07-10 18:41:30.560476118 +0000 UTC m=+689.943804371"
Jul 10 18:41:30.574934 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:30.574883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd" podStartSLOduration=1.86930485 podStartE2EDuration="3.574869065s" totalImagesPullingTime="1.705564215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:30.574282348 +0000 UTC m=+689.957610603" watchObservedRunningTime="2026-07-10 18:41:30.574869065 +0000 UTC m=+689.958197319"
Jul 10 18:41:36.549393 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:36.549365    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5647dfbb5b-c4kvz"
Jul 10 18:41:42.551231 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:41:42.551198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4jnqd"
Jul 10 18:42:07.188943 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.188908    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"]
Jul 10 18:42:07.192830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.192810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.195761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.195691    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 18:42:07.195761 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.195697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-69xjn\""
Jul 10 18:42:07.195963 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.195773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 10 18:42:07.195963 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.195779    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 18:42:07.205086 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.205060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"]
Jul 10 18:42:07.274612 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.274778 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnd6b\" (UniqueName: \"kubernetes.io/projected/5400b889-c58a-484d-9c93-f58d795be13f-kube-api-access-bnd6b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.274778 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.274778 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.274908 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.274908 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.274811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5400b889-c58a-484d-9c93-f58d795be13f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnd6b\" (UniqueName: \"kubernetes.io/projected/5400b889-c58a-484d-9c93-f58d795be13f-kube-api-access-bnd6b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375868 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375868 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375868 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5400b889-c58a-484d-9c93-f58d795be13f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.375868 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.375820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.376174 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.376138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.376225 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.376173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.376342 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.376321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.378081 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.378032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5400b889-c58a-484d-9c93-f58d795be13f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.378353 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.378335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5400b889-c58a-484d-9c93-f58d795be13f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.383335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.383310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnd6b\" (UniqueName: \"kubernetes.io/projected/5400b889-c58a-484d-9c93-f58d795be13f-kube-api-access-bnd6b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z6877\" (UID: \"5400b889-c58a-484d-9c93-f58d795be13f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.505526 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.505430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:07.641293 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.641246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"]
Jul 10 18:42:07.718183 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:07.718148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877" event={"ID":"5400b889-c58a-484d-9c93-f58d795be13f","Type":"ContainerStarted","Data":"9d42cbf5a9db7a2fd3bccc27afb52f217570a32cc53560ede06c24c5cf17c658"}
Jul 10 18:42:09.732552 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:09.732516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877" event={"ID":"5400b889-c58a-484d-9c93-f58d795be13f","Type":"ContainerStarted","Data":"91e1683dcb83226cd9a273050c987c3a282b5948283b4ab5de201b714682132d"}
Jul 10 18:42:09.751798 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:09.751741    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877" podStartSLOduration=1.6961570639999999 podStartE2EDuration="2.751724923s" totalImagesPullingTime="1.055567859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:09.750289359 +0000 UTC m=+729.133617613" watchObservedRunningTime="2026-07-10 18:42:09.751724923 +0000 UTC m=+729.135053197"
Jul 10 18:42:11.783663 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.783626    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"]
Jul 10 18:42:11.787047 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.787018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.789217 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.789196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 18:42:11.797358 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.797336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"]
Jul 10 18:42:11.920816 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.920775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.920997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.920861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.920997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.920883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxwwl\" (UniqueName: \"kubernetes.io/projected/47b76272-3f45-4ee4-90d4-da358ec7835b-kube-api-access-cxwwl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.920997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.920958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.920997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.920986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b76272-3f45-4ee4-90d4-da358ec7835b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:11.921176 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:11.921031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b76272-3f45-4ee4-90d4-da358ec7835b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022677 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022878 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxwwl\" (UniqueName: \"kubernetes.io/projected/47b76272-3f45-4ee4-90d4-da358ec7835b-kube-api-access-cxwwl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.022966 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.023027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.022993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.023027 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.023014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.024903 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.024878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b76272-3f45-4ee4-90d4-da358ec7835b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.025187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.025167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b76272-3f45-4ee4-90d4-da358ec7835b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.031083 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.031057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxwwl\" (UniqueName: \"kubernetes.io/projected/47b76272-3f45-4ee4-90d4-da358ec7835b-kube-api-access-cxwwl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnn2f\" (UID: \"47b76272-3f45-4ee4-90d4-da358ec7835b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.099835 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.099794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:12.233997 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.233973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"]
Jul 10 18:42:12.236489 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:42:12.236456    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b76272_3f45_4ee4_90d4_da358ec7835b.slice/crio-022eb95d3f2e68101a81feabc8ecf69e827738782650a3b5193af4682adf0d9b WatchSource:0}: Error finding container 022eb95d3f2e68101a81feabc8ecf69e827738782650a3b5193af4682adf0d9b: Status 404 returned error can't find the container with id 022eb95d3f2e68101a81feabc8ecf69e827738782650a3b5193af4682adf0d9b
Jul 10 18:42:12.748174 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.748079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f" event={"ID":"47b76272-3f45-4ee4-90d4-da358ec7835b","Type":"ContainerStarted","Data":"304fbdf00145d9c70c6a9337e1bf175ed88d4df3986cec02c7079e52cd574d15"}
Jul 10 18:42:12.748174 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.748148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f" event={"ID":"47b76272-3f45-4ee4-90d4-da358ec7835b","Type":"ContainerStarted","Data":"022eb95d3f2e68101a81feabc8ecf69e827738782650a3b5193af4682adf0d9b"}
Jul 10 18:42:12.765749 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:12.765694    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f" podStartSLOduration=1.608754578 podStartE2EDuration="1.765679164s" totalImagesPullingTime="156.924586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:12.763604468 +0000 UTC m=+732.146932724" watchObservedRunningTime="2026-07-10 18:42:12.765679164 +0000 UTC m=+732.149007480"
Jul 10 18:42:17.506427 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:17.506379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:17.506895 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:17.506455    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:17.519510 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:17.519475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:17.784951 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:17.784926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z6877"
Jul 10 18:42:22.100948 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:22.100910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:22.101469 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:22.101083    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:22.113628 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:22.113597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:42:22.809499 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:42:22.809471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnn2f"
Jul 10 18:43:29.205880 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.205793    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-857885d594-549nz"]
Jul 10 18:43:29.209609 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.209583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.219487 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.219459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857885d594-549nz"]
Jul 10 18:43:29.378122 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.378080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4j6\" (UniqueName: \"kubernetes.io/projected/efbfa798-0120-4d12-8fdc-03dd6e0c9834-kube-api-access-rk4j6\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.378282 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.378152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efbfa798-0120-4d12-8fdc-03dd6e0c9834-tls-cert\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.479416 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.479316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efbfa798-0120-4d12-8fdc-03dd6e0c9834-tls-cert\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.479606 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.479451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4j6\" (UniqueName: \"kubernetes.io/projected/efbfa798-0120-4d12-8fdc-03dd6e0c9834-kube-api-access-rk4j6\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.481863 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.481837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efbfa798-0120-4d12-8fdc-03dd6e0c9834-tls-cert\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.486930 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.486909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4j6\" (UniqueName: \"kubernetes.io/projected/efbfa798-0120-4d12-8fdc-03dd6e0c9834-kube-api-access-rk4j6\") pod \"authorino-857885d594-549nz\" (UID: \"efbfa798-0120-4d12-8fdc-03dd6e0c9834\") " pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.520096 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.520057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857885d594-549nz"
Jul 10 18:43:29.654361 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:29.654335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857885d594-549nz"]
Jul 10 18:43:29.656753 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:43:29.656723    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefbfa798_0120_4d12_8fdc_03dd6e0c9834.slice/crio-9b31cabf9d47979fe8e74be55b411d60e7c86f8ac91c2d12e92c0e368acce780 WatchSource:0}: Error finding container 9b31cabf9d47979fe8e74be55b411d60e7c86f8ac91c2d12e92c0e368acce780: Status 404 returned error can't find the container with id 9b31cabf9d47979fe8e74be55b411d60e7c86f8ac91c2d12e92c0e368acce780
Jul 10 18:43:30.133025 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.132992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857885d594-549nz" event={"ID":"efbfa798-0120-4d12-8fdc-03dd6e0c9834","Type":"ContainerStarted","Data":"dbc94b0367f4e6c9bca537522f58344a7268147afd0b70ca856d65aa6a167f1e"}
Jul 10 18:43:30.133196 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.133052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857885d594-549nz" event={"ID":"efbfa798-0120-4d12-8fdc-03dd6e0c9834","Type":"ContainerStarted","Data":"9b31cabf9d47979fe8e74be55b411d60e7c86f8ac91c2d12e92c0e368acce780"}
Jul 10 18:43:30.150641 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.150583    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-857885d594-549nz" podStartSLOduration=0.779771224 podStartE2EDuration="1.150565673s" totalImagesPullingTime="370.794449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:30.148767965 +0000 UTC m=+809.532096220" watchObservedRunningTime="2026-07-10 18:43:30.150565673 +0000 UTC m=+809.533893929"
Jul 10 18:43:30.179216 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.179178    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:43:30.179816 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.179722    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-799ff7cc8c-57llr" podUID="7a79d033-54c0-42bd-99ee-9be0047b771a" containerName="authorino" containerID="cri-o://ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75" gracePeriod=30
Jul 10 18:43:30.440780 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.440755    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:43:30.590838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.590743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert\") pod \"7a79d033-54c0-42bd-99ee-9be0047b771a\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") "
Jul 10 18:43:30.590838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.590798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kxd9\" (UniqueName: \"kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9\") pod \"7a79d033-54c0-42bd-99ee-9be0047b771a\" (UID: \"7a79d033-54c0-42bd-99ee-9be0047b771a\") "
Jul 10 18:43:30.592891 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.592859    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9" (OuterVolumeSpecName: "kube-api-access-2kxd9") pod "7a79d033-54c0-42bd-99ee-9be0047b771a" (UID: "7a79d033-54c0-42bd-99ee-9be0047b771a"). InnerVolumeSpecName "kube-api-access-2kxd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:43:30.601815 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.601789    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a79d033-54c0-42bd-99ee-9be0047b771a" (UID: "7a79d033-54c0-42bd-99ee-9be0047b771a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:43:30.692336 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.692300    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a79d033-54c0-42bd-99ee-9be0047b771a-tls-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:43:30.692336 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:30.692328    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kxd9\" (UniqueName: \"kubernetes.io/projected/7a79d033-54c0-42bd-99ee-9be0047b771a-kube-api-access-2kxd9\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:43:31.143072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.140171    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a79d033-54c0-42bd-99ee-9be0047b771a" containerID="ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75" exitCode=0
Jul 10 18:43:31.143072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.140806    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799ff7cc8c-57llr"
Jul 10 18:43:31.143072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.141694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799ff7cc8c-57llr" event={"ID":"7a79d033-54c0-42bd-99ee-9be0047b771a","Type":"ContainerDied","Data":"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"}
Jul 10 18:43:31.143072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.141738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799ff7cc8c-57llr" event={"ID":"7a79d033-54c0-42bd-99ee-9be0047b771a","Type":"ContainerDied","Data":"0d41e79ee618f8bbcd06bfd75bdcb6b2fc15fab72a39ad734f32d8c22a9a2361"}
Jul 10 18:43:31.143072 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.141761    2580 scope.go:117] "RemoveContainer" containerID="ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"
Jul 10 18:43:31.154250 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.154230    2580 scope.go:117] "RemoveContainer" containerID="ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"
Jul 10 18:43:31.154602 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:43:31.154578    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75\": container with ID starting with ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75 not found: ID does not exist" containerID="ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"
Jul 10 18:43:31.154668 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.154616    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75"} err="failed to get container status \"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75\": rpc error: code = NotFound desc = could not find container \"ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75\": container with ID starting with ed7110bf599d515ca55370a8f63b2b9f307c7b6d00be7297f275e3c54e18ed75 not found: ID does not exist"
Jul 10 18:43:31.167480 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.167450    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:43:31.170298 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.170273    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-799ff7cc8c-57llr"]
Jul 10 18:43:31.252994 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:43:31.252947    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a79d033-54c0-42bd-99ee-9be0047b771a" path="/var/lib/kubelet/pods/7a79d033-54c0-42bd-99ee-9be0047b771a/volumes"
Jul 10 18:44:44.609150 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:44.609117    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:44:44.609660 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:44.609351    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" podUID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" containerName="manager" containerID="cri-o://2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386" gracePeriod=30
Jul 10 18:44:44.858971 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:44.858943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:44:44.999558 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:44.999469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") pod \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") "
Jul 10 18:44:44.999710 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:44.999570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4pqv\" (UniqueName: \"kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv\") pod \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\" (UID: \"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c\") "
Jul 10 18:44:45.001629 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.001598    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv" (OuterVolumeSpecName: "kube-api-access-v4pqv") pod "0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" (UID: "0bc37e2f-7a56-4f61-9960-fe24b96e7d7c"). InnerVolumeSpecName "kube-api-access-v4pqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:45.001629 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.001619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" (UID: "0bc37e2f-7a56-4f61-9960-fe24b96e7d7c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:44:45.100830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.100793    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4pqv\" (UniqueName: \"kubernetes.io/projected/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-kube-api-access-v4pqv\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:44:45.100830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.100823    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c-webhook-cert\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:44:45.500417 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.500376    2580 generic.go:356] "Generic (PLEG): container finished" podID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" containerID="2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386" exitCode=0
Jul 10 18:44:45.500588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.500423    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp"
Jul 10 18:44:45.500588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.500467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" event={"ID":"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c","Type":"ContainerDied","Data":"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"}
Jul 10 18:44:45.500588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.500529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-hcpkp" event={"ID":"0bc37e2f-7a56-4f61-9960-fe24b96e7d7c","Type":"ContainerDied","Data":"93217643ecfe21bf0fb7563c3a36ffbed2aa9b35d88210e34859ed7efbe946fe"}
Jul 10 18:44:45.500588 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.500562    2580 scope.go:117] "RemoveContainer" containerID="2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"
Jul 10 18:44:45.509625 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.509583    2580 scope.go:117] "RemoveContainer" containerID="2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"
Jul 10 18:44:45.509860 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:44:45.509841    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386\": container with ID starting with 2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386 not found: ID does not exist" containerID="2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"
Jul 10 18:44:45.509909 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.509869    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386"} err="failed to get container status \"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386\": rpc error: code = NotFound desc = could not find container \"2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386\": container with ID starting with 2a0546cae35316b4fc440ce60e18e90a723637af489a1abd29feac8d64036386 not found: ID does not exist"
Jul 10 18:44:45.516717 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.516692    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:44:45.520880 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:45.520856    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-hcpkp"]
Jul 10 18:44:46.223284 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223256    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-45tjj"]
Jul 10 18:44:46.223799 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223782    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a79d033-54c0-42bd-99ee-9be0047b771a" containerName="authorino"
Jul 10 18:44:46.223799 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a79d033-54c0-42bd-99ee-9be0047b771a" containerName="authorino"
Jul 10 18:44:46.223888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223821    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" containerName="manager"
Jul 10 18:44:46.223888 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223827    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" containerName="manager"
Jul 10 18:44:46.223955 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223888    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" containerName="manager"
Jul 10 18:44:46.223955 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.223900    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a79d033-54c0-42bd-99ee-9be0047b771a" containerName="authorino"
Jul 10 18:44:46.228094 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.228077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.231249 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.231226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv4v6\""
Jul 10 18:44:46.231249 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.231244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:44:46.231422 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.231301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:44:46.236343 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.236323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-45tjj"]
Jul 10 18:44:46.313559 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.313534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98468bee-7e9b-428b-9c86-6cced6bd3cda-webhook-cert\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.313699 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.313570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tssf\" (UniqueName: \"kubernetes.io/projected/98468bee-7e9b-428b-9c86-6cced6bd3cda-kube-api-access-4tssf\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.414885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.414841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98468bee-7e9b-428b-9c86-6cced6bd3cda-webhook-cert\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.414885 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.414884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tssf\" (UniqueName: \"kubernetes.io/projected/98468bee-7e9b-428b-9c86-6cced6bd3cda-kube-api-access-4tssf\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.417422 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.417403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98468bee-7e9b-428b-9c86-6cced6bd3cda-webhook-cert\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.423010 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.422986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tssf\" (UniqueName: \"kubernetes.io/projected/98468bee-7e9b-428b-9c86-6cced6bd3cda-kube-api-access-4tssf\") pod \"maas-controller-865c7ddc8b-45tjj\" (UID: \"98468bee-7e9b-428b-9c86-6cced6bd3cda\") " pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.563844 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.563812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:46.902752 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:46.902724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-865c7ddc8b-45tjj"]
Jul 10 18:44:46.904622 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:44:46.904593    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98468bee_7e9b_428b_9c86_6cced6bd3cda.slice/crio-8f9f48c4565e507466fadb90c298b7fda9dde75019b0d033103a7cac7006951c WatchSource:0}: Error finding container 8f9f48c4565e507466fadb90c298b7fda9dde75019b0d033103a7cac7006951c: Status 404 returned error can't find the container with id 8f9f48c4565e507466fadb90c298b7fda9dde75019b0d033103a7cac7006951c
Jul 10 18:44:47.252476 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:47.252383    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc37e2f-7a56-4f61-9960-fe24b96e7d7c" path="/var/lib/kubelet/pods/0bc37e2f-7a56-4f61-9960-fe24b96e7d7c/volumes"
Jul 10 18:44:47.513475 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:47.513379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-45tjj" event={"ID":"98468bee-7e9b-428b-9c86-6cced6bd3cda","Type":"ContainerStarted","Data":"40e794b0638390c00476e7f4335de9e4cad9e391a84243423807ee51538fc61e"}
Jul 10 18:44:47.513475 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:47.513435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-865c7ddc8b-45tjj" event={"ID":"98468bee-7e9b-428b-9c86-6cced6bd3cda","Type":"ContainerStarted","Data":"8f9f48c4565e507466fadb90c298b7fda9dde75019b0d033103a7cac7006951c"}
Jul 10 18:44:47.513665 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:47.513477    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:44:47.529887 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:47.529829    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-865c7ddc8b-45tjj" podStartSLOduration=1.12028342 podStartE2EDuration="1.529809034s" totalImagesPullingTime="409.525614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:44:47.529361086 +0000 UTC m=+886.912689341" watchObservedRunningTime="2026-07-10 18:44:47.529809034 +0000 UTC m=+886.913137289"
Jul 10 18:44:58.524266 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:44:58.524187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-865c7ddc8b-45tjj"
Jul 10 18:45:00.147554 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.147518    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:45:00.151021 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.151000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"
Jul 10 18:45:00.154215 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.154196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x2bmm\""
Jul 10 18:45:00.159838 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.159810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:45:00.161510 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.161492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"
Jul 10 18:45:00.300012 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.299987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:45:00.301921 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:45:00.301889    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a90334_f60b_4100_be27_2bcbeec748c2.slice/crio-8bec4c9dec640f217f23db3b1ee45d7c37c2bddab51726592d056c8209e3794c WatchSource:0}: Error finding container 8bec4c9dec640f217f23db3b1ee45d7c37c2bddab51726592d056c8209e3794c: Status 404 returned error can't find the container with id 8bec4c9dec640f217f23db3b1ee45d7c37c2bddab51726592d056c8209e3794c
Jul 10 18:45:00.577075 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:00.577032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" event={"ID":"70a90334-f60b-4100-be27-2bcbeec748c2","Type":"ContainerStarted","Data":"8bec4c9dec640f217f23db3b1ee45d7c37c2bddab51726592d056c8209e3794c"}
Jul 10 18:45:01.151462 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:01.151431    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:45:01.153146 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:01.153115    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:45:03.593378 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:03.593341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" event={"ID":"70a90334-f60b-4100-be27-2bcbeec748c2","Type":"ContainerStarted","Data":"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"}
Jul 10 18:45:03.608886 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:45:03.608833    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" podStartSLOduration=1.2894410490000001 podStartE2EDuration="3.608814675s" totalImagesPullingTime="2.319373626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:45:03.607275609 +0000 UTC m=+902.990603876" watchObservedRunningTime="2026-07-10 18:45:03.608814675 +0000 UTC m=+902.992142930"
Jul 10 18:46:00.011110 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:00.011070    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:46:00.013416 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:00.011270    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" podUID="70a90334-f60b-4100-be27-2bcbeec748c2" containerName="cleanup" containerID="cri-o://6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a" gracePeriod=30
Jul 10 18:46:30.193097 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:30.193069    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"
Jul 10 18:46:31.027403 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.027366    2580 generic.go:356] "Generic (PLEG): container finished" podID="70a90334-f60b-4100-be27-2bcbeec748c2" containerID="6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a" exitCode=137
Jul 10 18:46:31.027598 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.027415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"
Jul 10 18:46:31.027598 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.027455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" event={"ID":"70a90334-f60b-4100-be27-2bcbeec748c2","Type":"ContainerDied","Data":"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"}
Jul 10 18:46:31.027598 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.027510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q" event={"ID":"70a90334-f60b-4100-be27-2bcbeec748c2","Type":"ContainerDied","Data":"8bec4c9dec640f217f23db3b1ee45d7c37c2bddab51726592d056c8209e3794c"}
Jul 10 18:46:31.027598 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.027532    2580 scope.go:117] "RemoveContainer" containerID="6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"
Jul 10 18:46:31.036915 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.036895    2580 scope.go:117] "RemoveContainer" containerID="6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"
Jul 10 18:46:31.037261 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:46:31.037240    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a\": container with ID starting with 6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a not found: ID does not exist" containerID="6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"
Jul 10 18:46:31.037343 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.037270    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a"} err="failed to get container status \"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a\": rpc error: code = NotFound desc = could not find container \"6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a\": container with ID starting with 6476fcaf30319556278d8fdf5526ca09c6541e7f731710ff39061d26c660077a not found: ID does not exist"
Jul 10 18:46:31.049478 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.049446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:46:31.051240 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.051217    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-qgj2q"]
Jul 10 18:46:31.256054 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:46:31.256017    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a90334-f60b-4100-be27-2bcbeec748c2" path="/var/lib/kubelet/pods/70a90334-f60b-4100-be27-2bcbeec748c2/volumes"
Jul 10 18:50:01.182904 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:50:01.182871    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:50:01.185531 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:50:01.185511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:55:01.214280 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:55:01.214251    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:55:01.217689 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:55:01.217667    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 18:56:59.231295 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.231259    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:56:59.231788 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.231695    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a90334-f60b-4100-be27-2bcbeec748c2" containerName="cleanup"
Jul 10 18:56:59.231788 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.231707    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a90334-f60b-4100-be27-2bcbeec748c2" containerName="cleanup"
Jul 10 18:56:59.231869 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.231790    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a90334-f60b-4100-be27-2bcbeec748c2" containerName="cleanup"
Jul 10 18:56:59.235231 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.235211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.237619 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.237596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d487a3ed-serving-cert\""
Jul 10 18:56:59.253694 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.253670    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:56:59.307482 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.307451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.307643 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.307531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.307643 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.307573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvm2z\" (UniqueName: \"kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.409161 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.409130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.409321 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:56:59.409286    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-serving-cert: secret "maas-api-e2e-ait-d487a3ed-serving-cert" not found
Jul 10 18:56:59.409366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.409288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.409366 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:56:59.409359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls podName:cffcb062-b059-479e-93c9-6e510172e517 nodeName:}" failed. No retries permitted until 2026-07-10 18:56:59.909337881 +0000 UTC m=+1619.292666112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls") pod "maas-api-e2e-ait-d487a3ed-8654445477-86rs6" (UID: "cffcb062-b059-479e-93c9-6e510172e517") : secret "maas-api-e2e-ait-d487a3ed-serving-cert" not found
Jul 10 18:56:59.409443 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.409410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvm2z\" (UniqueName: \"kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.409817 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.409801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.418815 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.418787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvm2z\" (UniqueName: \"kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.915754 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.915714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:56:59.918301 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:56:59.918271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") pod \"maas-api-e2e-ait-d487a3ed-8654445477-86rs6\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:57:00.147098 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:00.147068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:57:00.287504 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:00.287474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:57:00.289314 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:57:00.289284    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffcb062_b059_479e_93c9_6e510172e517.slice/crio-0e7a4c02b627fee9ec829b7dacf64882755013d0ed7fc43b0d3225583d11e7cc WatchSource:0}: Error finding container 0e7a4c02b627fee9ec829b7dacf64882755013d0ed7fc43b0d3225583d11e7cc: Status 404 returned error can't find the container with id 0e7a4c02b627fee9ec829b7dacf64882755013d0ed7fc43b0d3225583d11e7cc
Jul 10 18:57:00.290746 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:00.290727    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:57:01.145366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:01.145279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" event={"ID":"cffcb062-b059-479e-93c9-6e510172e517","Type":"ContainerStarted","Data":"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"}
Jul 10 18:57:01.145366 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:01.145341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" event={"ID":"cffcb062-b059-479e-93c9-6e510172e517","Type":"ContainerStarted","Data":"0e7a4c02b627fee9ec829b7dacf64882755013d0ed7fc43b0d3225583d11e7cc"}
Jul 10 18:57:01.145559 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:01.145373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:57:01.167241 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:01.167181    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" podStartSLOduration=1.655075912 podStartE2EDuration="2.16716379s" totalImagesPullingTime="512.087878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:57:01.166118886 +0000 UTC m=+1620.549447142" watchObservedRunningTime="2026-07-10 18:57:01.16716379 +0000 UTC m=+1620.550492043"
Jul 10 18:57:04.643018 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.642979    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:57:04.643500 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.643249    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" podUID="cffcb062-b059-479e-93c9-6e510172e517" containerName="maas-api" containerID="cri-o://38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15" gracePeriod=30
Jul 10 18:57:04.890273 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.890247    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:57:04.966505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.966415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca\") pod \"cffcb062-b059-479e-93c9-6e510172e517\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") "
Jul 10 18:57:04.966505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.966455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") pod \"cffcb062-b059-479e-93c9-6e510172e517\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") "
Jul 10 18:57:04.966697 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.966584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvm2z\" (UniqueName: \"kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z\") pod \"cffcb062-b059-479e-93c9-6e510172e517\" (UID: \"cffcb062-b059-479e-93c9-6e510172e517\") "
Jul 10 18:57:04.966753 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.966731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cffcb062-b059-479e-93c9-6e510172e517" (UID: "cffcb062-b059-479e-93c9-6e510172e517"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:57:04.966959 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.966941    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cffcb062-b059-479e-93c9-6e510172e517-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:04.968617 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.968590    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cffcb062-b059-479e-93c9-6e510172e517" (UID: "cffcb062-b059-479e-93c9-6e510172e517"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:57:04.968731 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:04.968676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z" (OuterVolumeSpecName: "kube-api-access-lvm2z") pod "cffcb062-b059-479e-93c9-6e510172e517" (UID: "cffcb062-b059-479e-93c9-6e510172e517"). InnerVolumeSpecName "kube-api-access-lvm2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:57:05.067583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.067553    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cffcb062-b059-479e-93c9-6e510172e517-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:05.067583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.067579    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvm2z\" (UniqueName: \"kubernetes.io/projected/cffcb062-b059-479e-93c9-6e510172e517-kube-api-access-lvm2z\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:05.167187 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.167152    2580 generic.go:356] "Generic (PLEG): container finished" podID="cffcb062-b059-479e-93c9-6e510172e517" containerID="38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15" exitCode=0
Jul 10 18:57:05.167387 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.167226    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"
Jul 10 18:57:05.167387 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.167232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" event={"ID":"cffcb062-b059-479e-93c9-6e510172e517","Type":"ContainerDied","Data":"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"}
Jul 10 18:57:05.167387 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.167282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6" event={"ID":"cffcb062-b059-479e-93c9-6e510172e517","Type":"ContainerDied","Data":"0e7a4c02b627fee9ec829b7dacf64882755013d0ed7fc43b0d3225583d11e7cc"}
Jul 10 18:57:05.167387 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.167304    2580 scope.go:117] "RemoveContainer" containerID="38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"
Jul 10 18:57:05.176894 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.176875    2580 scope.go:117] "RemoveContainer" containerID="38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"
Jul 10 18:57:05.177175 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:57:05.177156    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15\": container with ID starting with 38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15 not found: ID does not exist" containerID="38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"
Jul 10 18:57:05.177229 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.177186    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15"} err="failed to get container status \"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15\": rpc error: code = NotFound desc = could not find container \"38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15\": container with ID starting with 38956111755ef2dd00c46e6522350f5c2fc6ba1e86eaebbc8d887dcef0f36b15 not found: ID does not exist"
Jul 10 18:57:05.188645 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.188619    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:57:05.192485 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.192459    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d487a3ed-8654445477-86rs6"]
Jul 10 18:57:05.251839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:05.251758    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cffcb062-b059-479e-93c9-6e510172e517" path="/var/lib/kubelet/pods/cffcb062-b059-479e-93c9-6e510172e517/volumes"
Jul 10 18:57:11.787219 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.787183    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:11.787626 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.787599    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffcb062-b059-479e-93c9-6e510172e517" containerName="maas-api"
Jul 10 18:57:11.787626 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.787611    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffcb062-b059-479e-93c9-6e510172e517" containerName="maas-api"
Jul 10 18:57:11.787709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.787698    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cffcb062-b059-479e-93c9-6e510172e517" containerName="maas-api"
Jul 10 18:57:11.792098 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.792076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:11.794415 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.794390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b016bb74-serving-cert\""
Jul 10 18:57:11.806709 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.806685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:11.933914 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.933878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:11.933914 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.933912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:11.934206 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:11.934092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.034880 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.034837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.035120 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.034900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.035120 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.034918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.035524 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.035500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.037367 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.037313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.047195 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.047174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l\") pod \"maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.102776 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.102743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:12.237021 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:12.236998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:12.238987 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:57:12.238956    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfae8260_2746_4b6e_a185_5ebf99a85cb8.slice/crio-6af67da1dc7bee087d0ec47579c6961038ceb799af2bb7cf511ca6d9ee88a044 WatchSource:0}: Error finding container 6af67da1dc7bee087d0ec47579c6961038ceb799af2bb7cf511ca6d9ee88a044: Status 404 returned error can't find the container with id 6af67da1dc7bee087d0ec47579c6961038ceb799af2bb7cf511ca6d9ee88a044
Jul 10 18:57:13.211190 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:13.211153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" event={"ID":"dfae8260-2746-4b6e-a185-5ebf99a85cb8","Type":"ContainerStarted","Data":"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"}
Jul 10 18:57:13.211618 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:13.211206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" event={"ID":"dfae8260-2746-4b6e-a185-5ebf99a85cb8","Type":"ContainerStarted","Data":"6af67da1dc7bee087d0ec47579c6961038ceb799af2bb7cf511ca6d9ee88a044"}
Jul 10 18:57:13.211618 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:13.211263    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:13.227150 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:13.227097    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" podStartSLOduration=1.8761743210000001 podStartE2EDuration="2.227077886s" totalImagesPullingTime="350.903565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:57:13.226542002 +0000 UTC m=+1632.609870257" watchObservedRunningTime="2026-07-10 18:57:13.227077886 +0000 UTC m=+1632.610406140"
Jul 10 18:57:17.315975 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.315940    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:17.316431 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.316169    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" podUID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" containerName="maas-api" containerID="cri-o://42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65" gracePeriod=30
Jul 10 18:57:17.321373 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.321349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:17.562807 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.562784    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:17.690467 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.690384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l\") pod \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") "
Jul 10 18:57:17.690467 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.690451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls\") pod \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") "
Jul 10 18:57:17.690684 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.690478    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca\") pod \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\" (UID: \"dfae8260-2746-4b6e-a185-5ebf99a85cb8\") "
Jul 10 18:57:17.690867 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.690840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfae8260-2746-4b6e-a185-5ebf99a85cb8" (UID: "dfae8260-2746-4b6e-a185-5ebf99a85cb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:57:17.692567 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.692539    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfae8260-2746-4b6e-a185-5ebf99a85cb8" (UID: "dfae8260-2746-4b6e-a185-5ebf99a85cb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:57:17.692702 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.692636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l" (OuterVolumeSpecName: "kube-api-access-vcn8l") pod "dfae8260-2746-4b6e-a185-5ebf99a85cb8" (UID: "dfae8260-2746-4b6e-a185-5ebf99a85cb8"). InnerVolumeSpecName "kube-api-access-vcn8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:57:17.791696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.791667    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfae8260-2746-4b6e-a185-5ebf99a85cb8-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:17.791696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.791692    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/dfae8260-2746-4b6e-a185-5ebf99a85cb8-kube-api-access-vcn8l\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:17.791696 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:17.791702    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfae8260-2746-4b6e-a185-5ebf99a85cb8-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:18.240363 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.240332    2580 generic.go:356] "Generic (PLEG): container finished" podID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" containerID="42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65" exitCode=0
Jul 10 18:57:18.240549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.240375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"
Jul 10 18:57:18.240549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.240405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" event={"ID":"dfae8260-2746-4b6e-a185-5ebf99a85cb8","Type":"ContainerDied","Data":"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"}
Jul 10 18:57:18.240549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.240445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt" event={"ID":"dfae8260-2746-4b6e-a185-5ebf99a85cb8","Type":"ContainerDied","Data":"6af67da1dc7bee087d0ec47579c6961038ceb799af2bb7cf511ca6d9ee88a044"}
Jul 10 18:57:18.240549 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.240465    2580 scope.go:117] "RemoveContainer" containerID="42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"
Jul 10 18:57:18.249500 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.249482    2580 scope.go:117] "RemoveContainer" containerID="42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"
Jul 10 18:57:18.249802 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:57:18.249784    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65\": container with ID starting with 42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65 not found: ID does not exist" containerID="42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"
Jul 10 18:57:18.249850 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.249812    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65"} err="failed to get container status \"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65\": rpc error: code = NotFound desc = could not find container \"42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65\": container with ID starting with 42eb1286e6d6aa9c7cf6ec57b9198b21bda978d45502779e742a384fae1d8a65 not found: ID does not exist"
Jul 10 18:57:18.261185 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.261161    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:18.265024 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:18.265001    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b016bb74-749bfb8c6c-mbspt"]
Jul 10 18:57:19.251805 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:19.251776    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" path="/var/lib/kubelet/pods/dfae8260-2746-4b6e-a185-5ebf99a85cb8/volumes"
Jul 10 18:57:30.689475 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.689445    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:30.689874 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.689822    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" containerName="maas-api"
Jul 10 18:57:30.689874 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.689832    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" containerName="maas-api"
Jul 10 18:57:30.689946 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.689911    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfae8260-2746-4b6e-a185-5ebf99a85cb8" containerName="maas-api"
Jul 10 18:57:30.694310 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.694290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.697150 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.697063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-77dcb9ba-serving-cert\""
Jul 10 18:57:30.702720 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.702699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:30.807972 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.807938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.808157 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.807979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.808157 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.808104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wkm\" (UniqueName: \"kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.908864 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.908830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.908864 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.908871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.909111 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.908918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wkm\" (UniqueName: \"kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.909495 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.909463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.911255 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.911234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:30.920829 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:30.920807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wkm\" (UniqueName: \"kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm\") pod \"maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:31.006655 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:31.006582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:31.159664 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:31.159636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:31.161887 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:57:31.161847    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028aee07_1b14_42da_b0c1_eae43983055d.slice/crio-069627aae5ef35abcdbb31b08262d0d8eb27f6fba934a3272522d852b0a1be7b WatchSource:0}: Error finding container 069627aae5ef35abcdbb31b08262d0d8eb27f6fba934a3272522d852b0a1be7b: Status 404 returned error can't find the container with id 069627aae5ef35abcdbb31b08262d0d8eb27f6fba934a3272522d852b0a1be7b
Jul 10 18:57:31.308983 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:31.308947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" event={"ID":"028aee07-1b14-42da-b0c1-eae43983055d","Type":"ContainerStarted","Data":"069627aae5ef35abcdbb31b08262d0d8eb27f6fba934a3272522d852b0a1be7b"}
Jul 10 18:57:32.315361 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:32.315323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" event={"ID":"028aee07-1b14-42da-b0c1-eae43983055d","Type":"ContainerStarted","Data":"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"}
Jul 10 18:57:32.315740 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:32.315429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:32.333830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:32.333787    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" podStartSLOduration=1.964615104 podStartE2EDuration="2.333773345s" totalImagesPullingTime="369.158241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:57:32.331525979 +0000 UTC m=+1651.714854234" watchObservedRunningTime="2026-07-10 18:57:32.333773345 +0000 UTC m=+1651.717101598"
Jul 10 18:57:35.402284 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.402247    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:35.402802 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.402440    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" podUID="028aee07-1b14-42da-b0c1-eae43983055d" containerName="maas-api" containerID="cri-o://76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e" gracePeriod=30
Jul 10 18:57:35.653620 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.653560    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:35.754458 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.754428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca\") pod \"028aee07-1b14-42da-b0c1-eae43983055d\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") "
Jul 10 18:57:35.754635 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.754468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls\") pod \"028aee07-1b14-42da-b0c1-eae43983055d\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") "
Jul 10 18:57:35.754635 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.754513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8wkm\" (UniqueName: \"kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm\") pod \"028aee07-1b14-42da-b0c1-eae43983055d\" (UID: \"028aee07-1b14-42da-b0c1-eae43983055d\") "
Jul 10 18:57:35.754882 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.754853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "028aee07-1b14-42da-b0c1-eae43983055d" (UID: "028aee07-1b14-42da-b0c1-eae43983055d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:57:35.756590 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.756558    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "028aee07-1b14-42da-b0c1-eae43983055d" (UID: "028aee07-1b14-42da-b0c1-eae43983055d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:57:35.756747 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.756725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm" (OuterVolumeSpecName: "kube-api-access-z8wkm") pod "028aee07-1b14-42da-b0c1-eae43983055d" (UID: "028aee07-1b14-42da-b0c1-eae43983055d"). InnerVolumeSpecName "kube-api-access-z8wkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:57:35.855321 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.855293    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028aee07-1b14-42da-b0c1-eae43983055d-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:35.855462 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.855317    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028aee07-1b14-42da-b0c1-eae43983055d-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:35.855462 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:35.855341    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8wkm\" (UniqueName: \"kubernetes.io/projected/028aee07-1b14-42da-b0c1-eae43983055d-kube-api-access-z8wkm\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:57:36.337410 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.337374    2580 generic.go:356] "Generic (PLEG): container finished" podID="028aee07-1b14-42da-b0c1-eae43983055d" containerID="76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e" exitCode=0
Jul 10 18:57:36.337583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.337416    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"
Jul 10 18:57:36.337583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.337460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" event={"ID":"028aee07-1b14-42da-b0c1-eae43983055d","Type":"ContainerDied","Data":"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"}
Jul 10 18:57:36.337583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.337511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs" event={"ID":"028aee07-1b14-42da-b0c1-eae43983055d","Type":"ContainerDied","Data":"069627aae5ef35abcdbb31b08262d0d8eb27f6fba934a3272522d852b0a1be7b"}
Jul 10 18:57:36.337583 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.337535    2580 scope.go:117] "RemoveContainer" containerID="76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"
Jul 10 18:57:36.346967 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.346951    2580 scope.go:117] "RemoveContainer" containerID="76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"
Jul 10 18:57:36.347247 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:57:36.347225    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e\": container with ID starting with 76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e not found: ID does not exist" containerID="76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"
Jul 10 18:57:36.347343 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.347257    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e"} err="failed to get container status \"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e\": rpc error: code = NotFound desc = could not find container \"76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e\": container with ID starting with 76dc3487d1e84b27a827e1f6c8b7b6f0150752ce1b28df0255bec1060e54338e not found: ID does not exist"
Jul 10 18:57:36.358775 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.358751    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:36.362518 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:36.362496    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77dcb9ba-6df9fd767c-nczgs"]
Jul 10 18:57:37.251986 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:57:37.251949    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028aee07-1b14-42da-b0c1-eae43983055d" path="/var/lib/kubelet/pods/028aee07-1b14-42da-b0c1-eae43983055d/volumes"
Jul 10 18:59:18.572802 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.572755    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:18.573478 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.573393    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028aee07-1b14-42da-b0c1-eae43983055d" containerName="maas-api"
Jul 10 18:59:18.573478 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.573414    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="028aee07-1b14-42da-b0c1-eae43983055d" containerName="maas-api"
Jul 10 18:59:18.573627 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.573539    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="028aee07-1b14-42da-b0c1-eae43983055d" containerName="maas-api"
Jul 10 18:59:18.576858 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.576834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.578823 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.578799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c9361313-serving-cert\""
Jul 10 18:59:18.586591 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.586565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:18.721830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.721786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.721830 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.721829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnztl\" (UniqueName: \"kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.722080 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.721983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.823298 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.823195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.823298 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.823249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnztl\" (UniqueName: \"kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.823505 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.823351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.823987 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.823960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.825894 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.825866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.833647 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.833618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnztl\" (UniqueName: \"kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl\") pod \"maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:18.889442 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:18.889395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:19.031473 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:19.031301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:19.034019 ip-10-0-139-156 kubenswrapper[2580]: W0710 18:59:19.033991    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6ab65e_f78d_4cc4_8c9f_5ea4bb675a73.slice/crio-396c3ade7e14dbab33c4d46fd0560d9ead59da72af66870e2d20a9819a09fd0e WatchSource:0}: Error finding container 396c3ade7e14dbab33c4d46fd0560d9ead59da72af66870e2d20a9819a09fd0e: Status 404 returned error can't find the container with id 396c3ade7e14dbab33c4d46fd0560d9ead59da72af66870e2d20a9819a09fd0e
Jul 10 18:59:19.845059 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:19.845011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" event={"ID":"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73","Type":"ContainerStarted","Data":"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"}
Jul 10 18:59:19.845547 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:19.845091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" event={"ID":"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73","Type":"ContainerStarted","Data":"396c3ade7e14dbab33c4d46fd0560d9ead59da72af66870e2d20a9819a09fd0e"}
Jul 10 18:59:19.845547 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:19.845231    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:19.863873 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:19.863818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" podStartSLOduration=1.415283798 podStartE2EDuration="1.863799304s" totalImagesPullingTime="448.515506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:19.862322941 +0000 UTC m=+1759.245651195" watchObservedRunningTime="2026-07-10 18:59:19.863799304 +0000 UTC m=+1759.247127557"
Jul 10 18:59:25.855657 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:25.855621    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:30.520090 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.520026    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:30.520515 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.520324    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" podUID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" containerName="maas-api" containerID="cri-o://9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5" gracePeriod=30
Jul 10 18:59:30.766182 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.766158    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:30.829804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.829766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca\") pod \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") "
Jul 10 18:59:30.829804 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.829814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls\") pod \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") "
Jul 10 18:59:30.830079 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.829892    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnztl\" (UniqueName: \"kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl\") pod \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\" (UID: \"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73\") "
Jul 10 18:59:30.830171 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.830146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" (UID: "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:59:30.830249 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.830236    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:59:30.831982 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.831956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl" (OuterVolumeSpecName: "kube-api-access-wnztl") pod "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" (UID: "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73"). InnerVolumeSpecName "kube-api-access-wnztl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:59:30.832090 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.832001    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" (UID: "9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:59:30.903122 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.903089    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" containerID="9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5" exitCode=0
Jul 10 18:59:30.903277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.903135    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"
Jul 10 18:59:30.903277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.903137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" event={"ID":"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73","Type":"ContainerDied","Data":"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"}
Jul 10 18:59:30.903277 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.903254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb" event={"ID":"9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73","Type":"ContainerDied","Data":"396c3ade7e14dbab33c4d46fd0560d9ead59da72af66870e2d20a9819a09fd0e"}
Jul 10 18:59:30.903404 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.903285    2580 scope.go:117] "RemoveContainer" containerID="9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"
Jul 10 18:59:30.912839 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.912821    2580 scope.go:117] "RemoveContainer" containerID="9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"
Jul 10 18:59:30.913114 ip-10-0-139-156 kubenswrapper[2580]: E0710 18:59:30.913096    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5\": container with ID starting with 9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5 not found: ID does not exist" containerID="9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"
Jul 10 18:59:30.913191 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.913127    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5"} err="failed to get container status \"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5\": rpc error: code = NotFound desc = could not find container \"9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5\": container with ID starting with 9626f390b3ac1f62c58a13c9d38817a3c15f0b612d165c7659d04b7923a3e8a5 not found: ID does not exist"
Jul 10 18:59:30.923915 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.923890    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:30.930564 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.930541    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9361313-945cb8dc7-h4bbb"]
Jul 10 18:59:30.930908 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.930888    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnztl\" (UniqueName: \"kubernetes.io/projected/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-kube-api-access-wnztl\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:59:30.930957 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:30.930911    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 18:59:31.252223 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:31.252141    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" path="/var/lib/kubelet/pods/9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73/volumes"
Jul 10 18:59:59.812056 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.812006    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 18:59:59.812479 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.812450    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" containerName="maas-api"
Jul 10 18:59:59.812479 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.812464    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" containerName="maas-api"
Jul 10 18:59:59.812587 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.812550    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6ab65e-f78d-4cc4-8c9f-5ea4bb675a73" containerName="maas-api"
Jul 10 18:59:59.815822 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.815803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 18:59:59.817982 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.817960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b39babdc-serving-cert\""
Jul 10 18:59:59.828335 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.828310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 18:59:59.908655 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.908617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 18:59:59.908655 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.908656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 18:59:59.908871 ip-10-0-139-156 kubenswrapper[2580]: I0710 18:59:59.908680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrt5\" (UniqueName: \"kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.009509 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.009474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.009509 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.009510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrt5\" (UniqueName: \"kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.009758 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:00:00.009624    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-serving-cert: secret "maas-api-e2e-mt-b39babdc-serving-cert" not found
Jul 10 19:00:00.009758 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.009677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.009758 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:00:00.009706    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls podName:c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:00.509681111 +0000 UTC m=+1799.893009361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls") pod "maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" (UID: "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5") : secret "maas-api-e2e-mt-b39babdc-serving-cert" not found
Jul 10 19:00:00.010267 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.010245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.024212 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.024179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrt5\" (UniqueName: \"kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.133497 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.133408    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:00.137986 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.137964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"
Jul 10 19:00:00.140959 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.140939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x2bmm\""
Jul 10 19:00:00.144892 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.144870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:00.151093 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.151059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"
Jul 10 19:00:00.283728 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.283698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:00.286444 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:00:00.286401    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1462fd0d_15de_479b_bf48_1f70ee763aff.slice/crio-d005fa62233122716df607da2cf8233f0fc7a2948d6b5394e2c72301533d368b WatchSource:0}: Error finding container d005fa62233122716df607da2cf8233f0fc7a2948d6b5394e2c72301533d368b: Status 404 returned error can't find the container with id d005fa62233122716df607da2cf8233f0fc7a2948d6b5394e2c72301533d368b
Jul 10 19:00:00.514120 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.513995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.516425 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.516406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") pod \"maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.727210 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.727180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:00.863610 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:00.863579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 19:00:00.865976 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:00:00.865951    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6742f2a_2dd5_43d9_a2e8_c31a9f312ab5.slice/crio-1fd6eae92c6ef09211a2694206e2467c798aed37674b19def08a83096d4105f8 WatchSource:0}: Error finding container 1fd6eae92c6ef09211a2694206e2467c798aed37674b19def08a83096d4105f8: Status 404 returned error can't find the container with id 1fd6eae92c6ef09211a2694206e2467c798aed37674b19def08a83096d4105f8
Jul 10 19:00:01.052637 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.052607    2580 generic.go:356] "Generic (PLEG): container finished" podID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerID="0348a26dc71ac3139e4c886b3b5a0cb86d1dae23ef121111add617949d3f18b4" exitCode=7
Jul 10 19:00:01.052841 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.052693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerDied","Data":"0348a26dc71ac3139e4c886b3b5a0cb86d1dae23ef121111add617949d3f18b4"}
Jul 10 19:00:01.052841 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.052745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerStarted","Data":"d005fa62233122716df607da2cf8233f0fc7a2948d6b5394e2c72301533d368b"}
Jul 10 19:00:01.052841 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.052827    2580 scope.go:117] "RemoveContainer" containerID="0348a26dc71ac3139e4c886b3b5a0cb86d1dae23ef121111add617949d3f18b4"
Jul 10 19:00:01.053917 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.053896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" event={"ID":"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5","Type":"ContainerStarted","Data":"1fd6eae92c6ef09211a2694206e2467c798aed37674b19def08a83096d4105f8"}
Jul 10 19:00:01.246573 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.246546    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:00:01.251804 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:01.251780    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:00:02.060881 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.060837    2580 generic.go:356] "Generic (PLEG): container finished" podID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerID="3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6" exitCode=7
Jul 10 19:00:02.061535 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.060963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerDied","Data":"3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6"}
Jul 10 19:00:02.061535 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.061142    2580 scope.go:117] "RemoveContainer" containerID="0348a26dc71ac3139e4c886b3b5a0cb86d1dae23ef121111add617949d3f18b4"
Jul 10 19:00:02.061535 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.061351    2580 scope.go:117] "RemoveContainer" containerID="3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6"
Jul 10 19:00:02.061747 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:00:02.061668    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv_odh-ai-gateway-infra(1462fd0d-15de-479b-bf48-1f70ee763aff)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff"
Jul 10 19:00:02.063256 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.063231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" event={"ID":"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5","Type":"ContainerStarted","Data":"e4fd5143a1c1811c970e6a58895fe26c1b86c92945fa30f0936ec1fc34024cad"}
Jul 10 19:00:02.063342 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.063285    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:02.096876 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:02.096820    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" podStartSLOduration=2.527835061 podStartE2EDuration="3.096805225s" totalImagesPullingTime="568.970164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:02.095515218 +0000 UTC m=+1801.478843473" watchObservedRunningTime="2026-07-10 19:00:02.096805225 +0000 UTC m=+1801.480133479"
Jul 10 19:00:03.070365 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:03.070332    2580 scope.go:117] "RemoveContainer" containerID="3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6"
Jul 10 19:00:03.070871 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:00:03.070639    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv_odh-ai-gateway-infra(1462fd0d-15de-479b-bf48-1f70ee763aff)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff"
Jul 10 19:00:08.075895 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:08.075866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:15.247028 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:15.246995    2580 scope.go:117] "RemoveContainer" containerID="3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6"
Jul 10 19:00:16.137446 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:16.137405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerStarted","Data":"c3c3c806f6b6871e2fed299496ce0c93754f7a8ec34120a06ef9fde013be4b72"}
Jul 10 19:00:16.153750 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:16.153703    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" podStartSLOduration=16.153686999 podStartE2EDuration="16.153686999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:16.151790167 +0000 UTC m=+1815.535118423" watchObservedRunningTime="2026-07-10 19:00:16.153686999 +0000 UTC m=+1815.537015253"
Jul 10 19:00:17.165146 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:17.165114    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:17.165597 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:17.165291    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup" containerID="cri-o://c3c3c806f6b6871e2fed299496ce0c93754f7a8ec34120a06ef9fde013be4b72" gracePeriod=30
Jul 10 19:00:42.112191 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.112157    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 19:00:42.112768 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.112395    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" podUID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" containerName="maas-api" containerID="cri-o://e4fd5143a1c1811c970e6a58895fe26c1b86c92945fa30f0936ec1fc34024cad" gracePeriod=30
Jul 10 19:00:42.272216 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.272186    2580 generic.go:356] "Generic (PLEG): container finished" podID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" containerID="e4fd5143a1c1811c970e6a58895fe26c1b86c92945fa30f0936ec1fc34024cad" exitCode=0
Jul 10 19:00:42.272378 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.272259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" event={"ID":"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5","Type":"ContainerDied","Data":"e4fd5143a1c1811c970e6a58895fe26c1b86c92945fa30f0936ec1fc34024cad"}
Jul 10 19:00:42.363018 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.362959    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:42.512833 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.512795    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca\") pod \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") "
Jul 10 19:00:42.513033 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.512847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") pod \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") "
Jul 10 19:00:42.513033 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.512963    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxrt5\" (UniqueName: \"kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5\") pod \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\" (UID: \"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5\") "
Jul 10 19:00:42.513249 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.513225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" (UID: "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:00:42.513342 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.513327    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:00:42.514980 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.514957    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5" (OuterVolumeSpecName: "kube-api-access-sxrt5") pod "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" (UID: "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5"). InnerVolumeSpecName "kube-api-access-sxrt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:42.515103 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.514961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" (UID: "c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:00:42.614074 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.613968    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:00:42.614074 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:42.614000    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxrt5\" (UniqueName: \"kubernetes.io/projected/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5-kube-api-access-sxrt5\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:00:43.277795 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:43.277769    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"
Jul 10 19:00:43.278215 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:43.277760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2" event={"ID":"c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5","Type":"ContainerDied","Data":"1fd6eae92c6ef09211a2694206e2467c798aed37674b19def08a83096d4105f8"}
Jul 10 19:00:43.278215 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:43.277916    2580 scope.go:117] "RemoveContainer" containerID="e4fd5143a1c1811c970e6a58895fe26c1b86c92945fa30f0936ec1fc34024cad"
Jul 10 19:00:43.294845 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:43.294819    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 19:00:43.298688 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:43.298669    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b39babdc-7b646499fb-5dhg2"]
Jul 10 19:00:45.252753 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:45.252716    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" path="/var/lib/kubelet/pods/c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5/volumes"
Jul 10 19:00:47.300243 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:47.300209    2580 generic.go:356] "Generic (PLEG): container finished" podID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerID="c3c3c806f6b6871e2fed299496ce0c93754f7a8ec34120a06ef9fde013be4b72" exitCode=137
Jul 10 19:00:47.300625 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:47.300284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerDied","Data":"c3c3c806f6b6871e2fed299496ce0c93754f7a8ec34120a06ef9fde013be4b72"}
Jul 10 19:00:47.300625 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:47.300355    2580 scope.go:117] "RemoveContainer" containerID="3073928fddc609e52d0522a58a5252e1f7c7ce6559c155278500411e40c946e6"
Jul 10 19:00:47.366287 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:47.366263    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"
Jul 10 19:00:48.305744 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:48.305717    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"
Jul 10 19:00:48.306286 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:48.305743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv" event={"ID":"1462fd0d-15de-479b-bf48-1f70ee763aff","Type":"ContainerDied","Data":"d005fa62233122716df607da2cf8233f0fc7a2948d6b5394e2c72301533d368b"}
Jul 10 19:00:48.306286 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:48.305800    2580 scope.go:117] "RemoveContainer" containerID="c3c3c806f6b6871e2fed299496ce0c93754f7a8ec34120a06ef9fde013be4b72"
Jul 10 19:00:48.326915 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:48.326887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:48.330446 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:48.330422    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b39babdc-29728500-szvgv"]
Jul 10 19:00:49.252596 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:00:49.252560    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" path="/var/lib/kubelet/pods/1462fd0d-15de-479b-bf48-1f70ee763aff/volumes"
Jul 10 19:02:34.795994 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.795959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796362    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796374    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" containerName="maas-api"
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" containerName="maas-api"
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796408    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796456 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796413    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796648 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796477    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796648 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796486    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796648 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796494    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:34.796648 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.796503    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6742f2a-2dd5-43d9-a2e8-c31a9f312ab5" containerName="maas-api"
Jul 10 19:02:34.799519 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.799499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:34.802333 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.802308    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6b8252-serving-cert\""
Jul 10 19:02:34.810383 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.810358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:02:34.969972 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.969935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:34.970212 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.969983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgvk\" (UniqueName: \"kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:34.970212 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:34.970113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.071455 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.071360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.071455 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.071415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgvk\" (UniqueName: \"kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.071455 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.071454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.072123 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.072103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.073962 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.073932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.087309 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.087284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgvk\" (UniqueName: \"kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk\") pod \"maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.111170 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.111143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.259740 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.259717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:02:35.261743 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:02:35.261715    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bde6c61_4b97_4516_9fbc_a93013cfd541.slice/crio-a7973c4138954e0b8e7917981a9561d441621bf9570a7c3d6ca5d56f3f23bcfc WatchSource:0}: Error finding container a7973c4138954e0b8e7917981a9561d441621bf9570a7c3d6ca5d56f3f23bcfc: Status 404 returned error can't find the container with id a7973c4138954e0b8e7917981a9561d441621bf9570a7c3d6ca5d56f3f23bcfc
Jul 10 19:02:35.263494 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.263477    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:02:35.856358 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.856320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" event={"ID":"6bde6c61-4b97-4516-9fbc-a93013cfd541","Type":"ContainerStarted","Data":"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"}
Jul 10 19:02:35.856846 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.856386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" event={"ID":"6bde6c61-4b97-4516-9fbc-a93013cfd541","Type":"ContainerStarted","Data":"a7973c4138954e0b8e7917981a9561d441621bf9570a7c3d6ca5d56f3f23bcfc"}
Jul 10 19:02:35.856846 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.856418    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:35.872186 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:35.872139    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" podStartSLOduration=1.464413443 podStartE2EDuration="1.872125469s" totalImagesPullingTime="407.712026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:02:35.871152237 +0000 UTC m=+1955.254480492" watchObservedRunningTime="2026-07-10 19:02:35.872125469 +0000 UTC m=+1955.255453722"
Jul 10 19:02:41.873721 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:41.873690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:02:45.378139 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.378103    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:02:45.378517 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.378504    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:45.378560 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.378519    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1462fd0d-15de-479b-bf48-1f70ee763aff" containerName="cleanup"
Jul 10 19:02:45.381927 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.381908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.384530 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.384507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-12e952-serving-cert\""
Jul 10 19:02:45.395113 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.395087    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:02:45.469782 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.469750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.469952 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.469812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4dm\" (UniqueName: \"kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.469952 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.469882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.570444 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.570408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.570639 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.570502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4dm\" (UniqueName: \"kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.570639 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.570525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.570761 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:02:45.570672    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-serving-cert: secret "maas-api-e2e-inf-b-12e952-serving-cert" not found
Jul 10 19:02:45.570761 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:02:45.570749    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls podName:58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3 nodeName:}" failed. No retries permitted until 2026-07-10 19:02:46.070728221 +0000 UTC m=+1965.454056453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls") pod "maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" (UID: "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3") : secret "maas-api-e2e-inf-b-12e952-serving-cert" not found
Jul 10 19:02:45.571163 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.571139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:45.580228 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:45.580200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4dm\" (UniqueName: \"kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:46.074305 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.074265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:46.076733 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.076708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") pod \"maas-api-e2e-inf-b-12e952-b6c74c785-m45nh\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:46.292107 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.292075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:46.430813 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.430781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:02:46.433157 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:02:46.433129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b90f1d_5771_4a5c_9b58_e1bbc9e02bb3.slice/crio-e76533945e6b3d60e353fb0492d61152e05375d083dc029acffee93228390fe4 WatchSource:0}: Error finding container e76533945e6b3d60e353fb0492d61152e05375d083dc029acffee93228390fe4: Status 404 returned error can't find the container with id e76533945e6b3d60e353fb0492d61152e05375d083dc029acffee93228390fe4
Jul 10 19:02:46.921181 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.921145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" event={"ID":"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3","Type":"ContainerStarted","Data":"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"}
Jul 10 19:02:46.921387 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.921199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" event={"ID":"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3","Type":"ContainerStarted","Data":"e76533945e6b3d60e353fb0492d61152e05375d083dc029acffee93228390fe4"}
Jul 10 19:02:46.921387 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.921280    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:02:46.938508 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:46.938457    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" podStartSLOduration=1.573986642 podStartE2EDuration="1.938439527s" totalImagesPullingTime="364.452885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:02:46.936013166 +0000 UTC m=+1966.319341422" watchObservedRunningTime="2026-07-10 19:02:46.938439527 +0000 UTC m=+1966.321767801"
Jul 10 19:02:52.932094 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:02:52.932001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:03:34.748115 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:34.748076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:03:34.748666 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:34.748295    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" podUID="6bde6c61-4b97-4516-9fbc-a93013cfd541" containerName="maas-api" containerID="cri-o://4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c" gracePeriod=30
Jul 10 19:03:35.006002 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.005933    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:03:35.045333 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.045300    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls\") pod \"6bde6c61-4b97-4516-9fbc-a93013cfd541\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") "
Jul 10 19:03:35.045541 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.045360    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca\") pod \"6bde6c61-4b97-4516-9fbc-a93013cfd541\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") "
Jul 10 19:03:35.045541 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.045403    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqgvk\" (UniqueName: \"kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk\") pod \"6bde6c61-4b97-4516-9fbc-a93013cfd541\" (UID: \"6bde6c61-4b97-4516-9fbc-a93013cfd541\") "
Jul 10 19:03:35.045758 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.045730    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bde6c61-4b97-4516-9fbc-a93013cfd541" (UID: "6bde6c61-4b97-4516-9fbc-a93013cfd541"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:35.048156 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.048118    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bde6c61-4b97-4516-9fbc-a93013cfd541" (UID: "6bde6c61-4b97-4516-9fbc-a93013cfd541"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:03:35.048156 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.048134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk" (OuterVolumeSpecName: "kube-api-access-jqgvk") pod "6bde6c61-4b97-4516-9fbc-a93013cfd541" (UID: "6bde6c61-4b97-4516-9fbc-a93013cfd541"). InnerVolumeSpecName "kube-api-access-jqgvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:03:35.146708 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.146661    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bde6c61-4b97-4516-9fbc-a93013cfd541-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:03:35.146708 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.146703    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bde6c61-4b97-4516-9fbc-a93013cfd541-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:03:35.146708 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.146713    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqgvk\" (UniqueName: \"kubernetes.io/projected/6bde6c61-4b97-4516-9fbc-a93013cfd541-kube-api-access-jqgvk\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:03:35.160113 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.160082    2580 generic.go:356] "Generic (PLEG): container finished" podID="6bde6c61-4b97-4516-9fbc-a93013cfd541" containerID="4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c" exitCode=0
Jul 10 19:03:35.160285 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.160133    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"
Jul 10 19:03:35.160285 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.160170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" event={"ID":"6bde6c61-4b97-4516-9fbc-a93013cfd541","Type":"ContainerDied","Data":"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"}
Jul 10 19:03:35.160285 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.160234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c" event={"ID":"6bde6c61-4b97-4516-9fbc-a93013cfd541","Type":"ContainerDied","Data":"a7973c4138954e0b8e7917981a9561d441621bf9570a7c3d6ca5d56f3f23bcfc"}
Jul 10 19:03:35.160285 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.160257    2580 scope.go:117] "RemoveContainer" containerID="4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"
Jul 10 19:03:35.169271 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.169250    2580 scope.go:117] "RemoveContainer" containerID="4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"
Jul 10 19:03:35.169566 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:03:35.169546    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c\": container with ID starting with 4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c not found: ID does not exist" containerID="4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"
Jul 10 19:03:35.169625 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.169576    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c"} err="failed to get container status \"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c\": rpc error: code = NotFound desc = could not find container \"4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c\": container with ID starting with 4a49b7552b6e43eb3996928cf2e75fc626a5ee6bdb585c2d101527c381b8444c not found: ID does not exist"
Jul 10 19:03:35.182700 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.182666    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:03:35.186604 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.186575    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8252-64fd44db4f-sdk5c"]
Jul 10 19:03:35.252266 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:03:35.252231    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bde6c61-4b97-4516-9fbc-a93013cfd541" path="/var/lib/kubelet/pods/6bde6c61-4b97-4516-9fbc-a93013cfd541/volumes"
Jul 10 19:04:17.750061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:17.750012    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:04:17.750599 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:17.750251    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerName="maas-api" containerID="cri-o://d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38" gracePeriod=30
Jul 10 19:04:17.926615 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:17.926561    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.53:8443/health\": dial tcp 10.134.0.53:8443: connect: connection refused"
Jul 10 19:04:18.990026 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:18.990001    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:04:19.082391 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.082303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca\") pod \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") "
Jul 10 19:04:19.082391 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.082355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m4dm\" (UniqueName: \"kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm\") pod \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") "
Jul 10 19:04:19.082578 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.082404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") pod \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\" (UID: \"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3\") "
Jul 10 19:04:19.082682 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.082659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" (UID: "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:04:19.084508 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.084476    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" (UID: "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:04:19.084508 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.084478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm" (OuterVolumeSpecName: "kube-api-access-6m4dm") pod "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" (UID: "58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3"). InnerVolumeSpecName "kube-api-access-6m4dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:04:19.183757 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.183723    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:19.183757 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.183750    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m4dm\" (UniqueName: \"kubernetes.io/projected/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-kube-api-access-6m4dm\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:19.183757 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.183767    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:19.377790 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.377693    2580 generic.go:356] "Generic (PLEG): container finished" podID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerID="d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38" exitCode=0
Jul 10 19:04:19.377790 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.377726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" event={"ID":"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3","Type":"ContainerDied","Data":"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"}
Jul 10 19:04:19.377790 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.377785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh" event={"ID":"58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3","Type":"ContainerDied","Data":"e76533945e6b3d60e353fb0492d61152e05375d083dc029acffee93228390fe4"}
Jul 10 19:04:19.378072 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.377807    2580 scope.go:117] "RemoveContainer" containerID="d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"
Jul 10 19:04:19.378072 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.377742    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"
Jul 10 19:04:19.386479 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.386461    2580 scope.go:117] "RemoveContainer" containerID="d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"
Jul 10 19:04:19.386753 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:04:19.386734    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38\": container with ID starting with d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38 not found: ID does not exist" containerID="d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"
Jul 10 19:04:19.386817 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.386764    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38"} err="failed to get container status \"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38\": rpc error: code = NotFound desc = could not find container \"d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38\": container with ID starting with d69d76657334261c473a84158aa5805787ce354ad50d0336ebd90e50f7f97f38 not found: ID does not exist"
Jul 10 19:04:19.395217 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.395195    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:04:19.403252 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:19.403231    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12e952-b6c74c785-m45nh"]
Jul 10 19:04:21.252686 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:21.252654    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" path="/var/lib/kubelet/pods/58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3/volumes"
Jul 10 19:04:27.775408 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.775368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:27.776026 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.775995    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bde6c61-4b97-4516-9fbc-a93013cfd541" containerName="maas-api"
Jul 10 19:04:27.776026 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.776018    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bde6c61-4b97-4516-9fbc-a93013cfd541" containerName="maas-api"
Jul 10 19:04:27.776169 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.776059    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerName="maas-api"
Jul 10 19:04:27.776169 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.776069    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerName="maas-api"
Jul 10 19:04:27.776169 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.776144    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b90f1d-5771-4a5c-9b58-e1bbc9e02bb3" containerName="maas-api"
Jul 10 19:04:27.776169 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.776158    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bde6c61-4b97-4516-9fbc-a93013cfd541" containerName="maas-api"
Jul 10 19:04:27.780529 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.780513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.783289 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.783270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3870b4-serving-cert\""
Jul 10 19:04:27.790637 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.790615    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:27.863146 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.863111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7wq\" (UniqueName: \"kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.863308 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.863204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.863308 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.863235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.964359 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.964330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.964547 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.964368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.964547 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.964422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7wq\" (UniqueName: \"kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.964677 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:04:27.964569    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-serving-cert: secret "maas-api-e2e-api-a-3870b4-serving-cert" not found
Jul 10 19:04:27.964677 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:04:27.964646    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls podName:b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103 nodeName:}" failed. No retries permitted until 2026-07-10 19:04:28.464623816 +0000 UTC m=+2067.847952084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls") pod "maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" (UID: "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103") : secret "maas-api-e2e-api-a-3870b4-serving-cert" not found
Jul 10 19:04:27.965035 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.965014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:27.975103 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:27.975075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7wq\" (UniqueName: \"kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:28.471943 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:28.471906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:28.474315 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:28.474288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") pod \"maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:28.693191 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:28.693149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:28.834640 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:28.834605    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:28.836296 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:04:28.836269    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f5ae9e_d3b9_4a18_afb6_6cffc3bba103.slice/crio-f59e77ba56a84b10fa11e7279da8ca7147a541df295495d220efb2991970d78b WatchSource:0}: Error finding container f59e77ba56a84b10fa11e7279da8ca7147a541df295495d220efb2991970d78b: Status 404 returned error can't find the container with id f59e77ba56a84b10fa11e7279da8ca7147a541df295495d220efb2991970d78b
Jul 10 19:04:29.428542 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:29.428509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" event={"ID":"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103","Type":"ContainerStarted","Data":"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"}
Jul 10 19:04:29.428712 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:29.428561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" event={"ID":"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103","Type":"ContainerStarted","Data":"f59e77ba56a84b10fa11e7279da8ca7147a541df295495d220efb2991970d78b"}
Jul 10 19:04:29.428712 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:29.428648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:29.446091 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:29.446029    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" podStartSLOduration=1.990336893 podStartE2EDuration="2.446012636s" totalImagesPullingTime="455.675743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:29.445266611 +0000 UTC m=+2068.828594866" watchObservedRunningTime="2026-07-10 19:04:29.446012636 +0000 UTC m=+2068.829340890"
Jul 10 19:04:35.440125 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.440080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:35.843331 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.843297    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:35.847517 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.847491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:35.849666 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.849644    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ba3fa5-serving-cert\""
Jul 10 19:04:35.863874 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.863846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:35.947587 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.947554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7fb\" (UniqueName: \"kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:35.947798 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.947605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:35.947798 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:35.947696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.048379 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.048339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7fb\" (UniqueName: \"kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.048582 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.048386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.048582 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.048451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.049131 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.049109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.050830 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.050808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.057433 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.057411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7fb\" (UniqueName: \"kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb\") pod \"maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.160626 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.160538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:36.340885 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.340856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:36.343108 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:04:36.343077    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6571e4b_ec09_4b0c_aaf0_1c4aad74ec3c.slice/crio-a32b4ee7b422a3fce595729d72e3e3dbf7a6288a27e90777738c4221a758a7ce WatchSource:0}: Error finding container a32b4ee7b422a3fce595729d72e3e3dbf7a6288a27e90777738c4221a758a7ce: Status 404 returned error can't find the container with id a32b4ee7b422a3fce595729d72e3e3dbf7a6288a27e90777738c4221a758a7ce
Jul 10 19:04:36.464074 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:36.463960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" event={"ID":"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c","Type":"ContainerStarted","Data":"a32b4ee7b422a3fce595729d72e3e3dbf7a6288a27e90777738c4221a758a7ce"}
Jul 10 19:04:37.470436 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:37.470401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" event={"ID":"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c","Type":"ContainerStarted","Data":"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"}
Jul 10 19:04:37.470919 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:37.470518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:37.493730 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:37.493682    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" podStartSLOduration=2.109802315 podStartE2EDuration="2.493665427s" totalImagesPullingTime="383.863112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:37.491174678 +0000 UTC m=+2076.874502933" watchObservedRunningTime="2026-07-10 19:04:37.493665427 +0000 UTC m=+2076.876993681"
Jul 10 19:04:43.480920 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:43.480890    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:49.151484 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.151453    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:49.152065 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.151647    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" podUID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" containerName="maas-api" containerID="cri-o://28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1" gracePeriod=30
Jul 10 19:04:49.409382 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.409309    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:49.478137 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.478104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") pod \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") "
Jul 10 19:04:49.478341 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.478189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv7wq\" (UniqueName: \"kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq\") pod \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") "
Jul 10 19:04:49.478341 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.478242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca\") pod \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\" (UID: \"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103\") "
Jul 10 19:04:49.478604 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.478581    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" (UID: "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:04:49.480190 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.480166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" (UID: "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:04:49.480297 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.480172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq" (OuterVolumeSpecName: "kube-api-access-cv7wq") pod "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" (UID: "b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103"). InnerVolumeSpecName "kube-api-access-cv7wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:04:49.532289 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.532251    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" containerID="28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1" exitCode=0
Jul 10 19:04:49.532450 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.532304    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"
Jul 10 19:04:49.532450 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.532318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" event={"ID":"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103","Type":"ContainerDied","Data":"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"}
Jul 10 19:04:49.532450 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.532371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f" event={"ID":"b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103","Type":"ContainerDied","Data":"f59e77ba56a84b10fa11e7279da8ca7147a541df295495d220efb2991970d78b"}
Jul 10 19:04:49.532450 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.532402    2580 scope.go:117] "RemoveContainer" containerID="28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"
Jul 10 19:04:49.541835 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.541817    2580 scope.go:117] "RemoveContainer" containerID="28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"
Jul 10 19:04:49.542096 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:04:49.542077    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1\": container with ID starting with 28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1 not found: ID does not exist" containerID="28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"
Jul 10 19:04:49.542146 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.542105    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1"} err="failed to get container status \"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1\": rpc error: code = NotFound desc = could not find container \"28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1\": container with ID starting with 28bcc089c716fb826fa395b77887387b4f7f65c299afc19fe7ddf8c4cbe5eee1 not found: ID does not exist"
Jul 10 19:04:49.554283 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.554254    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:49.557432 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.557408    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3870b4-86f89d544c-l4w8f"]
Jul 10 19:04:49.579782 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.579755    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:49.579782 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.579781    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv7wq\" (UniqueName: \"kubernetes.io/projected/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-kube-api-access-cv7wq\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:49.579939 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:49.579793    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:51.253073 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:51.253029    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" path="/var/lib/kubelet/pods/b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103/volumes"
Jul 10 19:04:55.852281 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:55.852251    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:55.852781 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:55.852448    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" podUID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" containerName="maas-api" containerID="cri-o://37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc" gracePeriod=30
Jul 10 19:04:56.098504 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.098475    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:56.140672 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.140596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca\") pod \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") "
Jul 10 19:04:56.140810 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.140734    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs7fb\" (UniqueName: \"kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb\") pod \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") "
Jul 10 19:04:56.140810 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.140757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls\") pod \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\" (UID: \"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c\") "
Jul 10 19:04:56.140969 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.140940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" (UID: "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:04:56.142869 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.142840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" (UID: "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:04:56.142981 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.142863    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb" (OuterVolumeSpecName: "kube-api-access-cs7fb") pod "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" (UID: "f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c"). InnerVolumeSpecName "kube-api-access-cs7fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:04:56.241714 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.241669    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs7fb\" (UniqueName: \"kubernetes.io/projected/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-kube-api-access-cs7fb\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:56.241714 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.241708    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:56.241714 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.241720    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:04:56.565932 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.565897    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" containerID="37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc" exitCode=0
Jul 10 19:04:56.566154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.565950    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"
Jul 10 19:04:56.566154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.565983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" event={"ID":"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c","Type":"ContainerDied","Data":"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"}
Jul 10 19:04:56.566154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.566060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9" event={"ID":"f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c","Type":"ContainerDied","Data":"a32b4ee7b422a3fce595729d72e3e3dbf7a6288a27e90777738c4221a758a7ce"}
Jul 10 19:04:56.566154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.566073    2580 scope.go:117] "RemoveContainer" containerID="37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"
Jul 10 19:04:56.575804 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.575788    2580 scope.go:117] "RemoveContainer" containerID="37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"
Jul 10 19:04:56.576094 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:04:56.576074    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc\": container with ID starting with 37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc not found: ID does not exist" containerID="37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"
Jul 10 19:04:56.576188 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.576099    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc"} err="failed to get container status \"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc\": rpc error: code = NotFound desc = could not find container \"37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc\": container with ID starting with 37992c927786a9c6174ecb5deedc7374195474d167ba58010afe7830d8ebc0dc not found: ID does not exist"
Jul 10 19:04:56.586374 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.586353    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:56.589903 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:56.589882    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ba3fa5-77564b5646-qcfz9"]
Jul 10 19:04:57.253743 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:04:57.253700    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" path="/var/lib/kubelet/pods/f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c/volumes"
Jul 10 19:05:01.277534 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:01.277503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:05:01.283954 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:01.283934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:05:04.959630 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.959595    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:05:04.960164 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960141    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" containerName="maas-api"
Jul 10 19:05:04.960239 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960165    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" containerName="maas-api"
Jul 10 19:05:04.960239 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960190    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" containerName="maas-api"
Jul 10 19:05:04.960239 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960199    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" containerName="maas-api"
Jul 10 19:05:04.960414 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960292    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6571e4b-ec09-4b0c-aaf0-1c4aad74ec3c" containerName="maas-api"
Jul 10 19:05:04.960414 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.960303    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0f5ae9e-d3b9-4a18-afb6-6cffc3bba103" containerName="maas-api"
Jul 10 19:05:04.963389 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.963368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:04.965589 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.965561    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-33ca20-serving-cert\""
Jul 10 19:05:04.973506 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:04.973483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:05:05.029146 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.029109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh7kw\" (UniqueName: \"kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.029321 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.029243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.029321 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.029284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.130727 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.130689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh7kw\" (UniqueName: \"kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.130911 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.130750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.130911 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.130770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.130911 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:05:05.130886    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-serving-cert: secret "maas-api-e2e-shared-a-33ca20-serving-cert" not found
Jul 10 19:05:05.131066 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:05:05.130960    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls podName:b7d7dbc7-cc1a-48bc-ae07-ff728017fc13 nodeName:}" failed. No retries permitted until 2026-07-10 19:05:05.630941248 +0000 UTC m=+2105.014269493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls") pod "maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" (UID: "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13") : secret "maas-api-e2e-shared-a-33ca20-serving-cert" not found
Jul 10 19:05:05.131381 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.131365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.139674 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.139645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh7kw\" (UniqueName: \"kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.636134 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.636101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.638503 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.638481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") pod \"maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:05.876483 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:05.876442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:06.012157 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:06.012130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:05:06.014321 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:05:06.014293    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d7dbc7_cc1a_48bc_ae07_ff728017fc13.slice/crio-26da1f8bc0468d22e879d8c57133c64833704751a8a089d80762da628eda04fa WatchSource:0}: Error finding container 26da1f8bc0468d22e879d8c57133c64833704751a8a089d80762da628eda04fa: Status 404 returned error can't find the container with id 26da1f8bc0468d22e879d8c57133c64833704751a8a089d80762da628eda04fa
Jul 10 19:05:06.624463 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:06.624416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" event={"ID":"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13","Type":"ContainerStarted","Data":"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"}
Jul 10 19:05:06.624653 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:06.624562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:06.624653 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:06.624601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" event={"ID":"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13","Type":"ContainerStarted","Data":"26da1f8bc0468d22e879d8c57133c64833704751a8a089d80762da628eda04fa"}
Jul 10 19:05:06.642133 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:06.642079    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" podStartSLOduration=2.172641578 podStartE2EDuration="2.64205956s" totalImagesPullingTime="469.417982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:06.640105827 +0000 UTC m=+2106.023434085" watchObservedRunningTime="2026-07-10 19:05:06.64205956 +0000 UTC m=+2106.025387815"
Jul 10 19:05:12.635518 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:12.635490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:05:13.163829 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.163797    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:05:13.168149 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.168123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.170549 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.170526    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7b46a3-serving-cert\""
Jul 10 19:05:13.177465 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.177436    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:05:13.314536 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.314495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4h2x\" (UniqueName: \"kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.314536 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.314530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.314737 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.314574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.415627 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.415549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4h2x\" (UniqueName: \"kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.415627 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.415581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.415826 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.415637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.416340 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.416316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.418093 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.418065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.422870 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.422844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4h2x\" (UniqueName: \"kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x\") pod \"maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.482977 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.482946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:13.619521 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.619488    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:05:13.622722 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:05:13.622693    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81af93a4_c5d4_4ba5_84a5_fc0ab1dab8cb.slice/crio-105ded09d55cc58b00d3ea62827036d5bd16c5fd21a041f9241241e4d58def8e WatchSource:0}: Error finding container 105ded09d55cc58b00d3ea62827036d5bd16c5fd21a041f9241241e4d58def8e: Status 404 returned error can't find the container with id 105ded09d55cc58b00d3ea62827036d5bd16c5fd21a041f9241241e4d58def8e
Jul 10 19:05:13.662595 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:13.662562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" event={"ID":"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb","Type":"ContainerStarted","Data":"105ded09d55cc58b00d3ea62827036d5bd16c5fd21a041f9241241e4d58def8e"}
Jul 10 19:05:14.668735 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:14.668701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" event={"ID":"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb","Type":"ContainerStarted","Data":"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"}
Jul 10 19:05:14.669131 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:14.668810    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:05:14.691137 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:14.691088    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" podStartSLOduration=1.379670959 podStartE2EDuration="1.69107228s" totalImagesPullingTime="311.401321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:14.689027756 +0000 UTC m=+2114.072356004" watchObservedRunningTime="2026-07-10 19:05:14.69107228 +0000 UTC m=+2114.074400533"
Jul 10 19:05:20.680378 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:05:20.680345    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:10:01.314028 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:10:01.314001    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:10:01.319356 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:10:01.319334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krxrk_fe72758b-ccd8-4793-ac48-4aef1735923d/ovn-acl-logging/0.log"
Jul 10 19:11:11.875147 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:11.875108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7367-139972876092848"]
Jul 10 19:11:11.878658 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:11.878640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:11.880933 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:11.880913    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-jhhrg\""
Jul 10 19:11:11.886054 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:11.885796    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972876092848"]
Jul 10 19:11:12.014763 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.014717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c6gs\" (UniqueName: \"kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs\") pod \"test-curl-7367-139972876092848\" (UID: \"0030785c-5ff7-421e-938b-895b4eff9351\") " pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:12.115556 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.115519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c6gs\" (UniqueName: \"kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs\") pod \"test-curl-7367-139972876092848\" (UID: \"0030785c-5ff7-421e-938b-895b4eff9351\") " pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:12.123499 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.123464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c6gs\" (UniqueName: \"kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs\") pod \"test-curl-7367-139972876092848\" (UID: \"0030785c-5ff7-421e-938b-895b4eff9351\") " pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:12.189419 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.189339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:12.321809 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.321786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972876092848"]
Jul 10 19:11:12.323860 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:12.323830    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0030785c_5ff7_421e_938b_895b4eff9351.slice/crio-0e6990f7edabb94807f4034fd5833fb74a9cb78d2675db8a48b8e33496f474be WatchSource:0}: Error finding container 0e6990f7edabb94807f4034fd5833fb74a9cb78d2675db8a48b8e33496f474be: Status 404 returned error can't find the container with id 0e6990f7edabb94807f4034fd5833fb74a9cb78d2675db8a48b8e33496f474be
Jul 10 19:11:12.325318 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.325297    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:11:12.447973 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:12.447885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972876092848" event={"ID":"0030785c-5ff7-421e-938b-895b4eff9351","Type":"ContainerStarted","Data":"0e6990f7edabb94807f4034fd5833fb74a9cb78d2675db8a48b8e33496f474be"}
Jul 10 19:11:13.454723 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:13.454690    2580 generic.go:356] "Generic (PLEG): container finished" podID="0030785c-5ff7-421e-938b-895b4eff9351" containerID="137668a5411606822378deb55ea46476796c5cbc413d302981512d8632c5644e" exitCode=0
Jul 10 19:11:13.455201 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:13.454780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972876092848" event={"ID":"0030785c-5ff7-421e-938b-895b4eff9351","Type":"ContainerDied","Data":"137668a5411606822378deb55ea46476796c5cbc413d302981512d8632c5644e"}
Jul 10 19:11:14.597887 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.597862    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:14.635701 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.635678    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7367-139972876092848_0030785c-5ff7-421e-938b-895b4eff9351/test-curl-7367-139972876092848/0.log"
Jul 10 19:11:14.660505 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.660476    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7367-139972876092848"]
Jul 10 19:11:14.666076 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.666050    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7367-139972876092848"]
Jul 10 19:11:14.742942 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.742862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c6gs\" (UniqueName: \"kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs\") pod \"0030785c-5ff7-421e-938b-895b4eff9351\" (UID: \"0030785c-5ff7-421e-938b-895b4eff9351\") "
Jul 10 19:11:14.745164 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.745136    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs" (OuterVolumeSpecName: "kube-api-access-4c6gs") pod "0030785c-5ff7-421e-938b-895b4eff9351" (UID: "0030785c-5ff7-421e-938b-895b4eff9351"). InnerVolumeSpecName "kube-api-access-4c6gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:14.784967 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.784931    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7367-139972876094640"]
Jul 10 19:11:14.785392 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.785378    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0030785c-5ff7-421e-938b-895b4eff9351" containerName="test-curl-7367-139972876092848"
Jul 10 19:11:14.785436 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.785393    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0030785c-5ff7-421e-938b-895b4eff9351" containerName="test-curl-7367-139972876092848"
Jul 10 19:11:14.785485 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.785454    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0030785c-5ff7-421e-938b-895b4eff9351" containerName="test-curl-7367-139972876092848"
Jul 10 19:11:14.788485 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.788469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:14.792439 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.792412    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972876094640"]
Jul 10 19:11:14.844732 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.844700    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c6gs\" (UniqueName: \"kubernetes.io/projected/0030785c-5ff7-421e-938b-895b4eff9351-kube-api-access-4c6gs\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:14.945257 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:14.945222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnq4f\" (UniqueName: \"kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f\") pod \"test-curl-7367-139972876094640\" (UID: \"12c650c3-305e-42ac-b2d3-08ca0546abdb\") " pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:15.046492 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.046456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnq4f\" (UniqueName: \"kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f\") pod \"test-curl-7367-139972876094640\" (UID: \"12c650c3-305e-42ac-b2d3-08ca0546abdb\") " pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:15.054913 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.054884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnq4f\" (UniqueName: \"kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f\") pod \"test-curl-7367-139972876094640\" (UID: \"12c650c3-305e-42ac-b2d3-08ca0546abdb\") " pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:15.098902 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.098874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:15.230030 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.230012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972876094640"]
Jul 10 19:11:15.232694 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:15.232665    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12c650c3_305e_42ac_b2d3_08ca0546abdb.slice/crio-2177a64d0918249d0ff7afe0ee7451f396fe1505e55ae4e6cb82f26ea493bdfb WatchSource:0}: Error finding container 2177a64d0918249d0ff7afe0ee7451f396fe1505e55ae4e6cb82f26ea493bdfb: Status 404 returned error can't find the container with id 2177a64d0918249d0ff7afe0ee7451f396fe1505e55ae4e6cb82f26ea493bdfb
Jul 10 19:11:15.252676 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.252649    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0030785c-5ff7-421e-938b-895b4eff9351" path="/var/lib/kubelet/pods/0030785c-5ff7-421e-938b-895b4eff9351/volumes"
Jul 10 19:11:15.466401 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.466318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876092848"
Jul 10 19:11:15.466401 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.466348    2580 scope.go:117] "RemoveContainer" containerID="137668a5411606822378deb55ea46476796c5cbc413d302981512d8632c5644e"
Jul 10 19:11:15.467814 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:15.467668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972876094640" event={"ID":"12c650c3-305e-42ac-b2d3-08ca0546abdb","Type":"ContainerStarted","Data":"2177a64d0918249d0ff7afe0ee7451f396fe1505e55ae4e6cb82f26ea493bdfb"}
Jul 10 19:11:16.475126 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:16.475094    2580 generic.go:356] "Generic (PLEG): container finished" podID="12c650c3-305e-42ac-b2d3-08ca0546abdb" containerID="dd52c41808b550de79fc7d3ae8806155c4e5bf0f7b071a44c3d54b26ab3f904f" exitCode=0
Jul 10 19:11:16.475529 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:16.475153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972876094640" event={"ID":"12c650c3-305e-42ac-b2d3-08ca0546abdb","Type":"ContainerDied","Data":"dd52c41808b550de79fc7d3ae8806155c4e5bf0f7b071a44c3d54b26ab3f904f"}
Jul 10 19:11:17.623094 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.623069    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:17.641786 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.641757    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7367-139972876094640_12c650c3-305e-42ac-b2d3-08ca0546abdb/test-curl-7367-139972876094640/0.log"
Jul 10 19:11:17.664124 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.664092    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7367-139972876094640"]
Jul 10 19:11:17.668640 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.668613    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7367-139972876094640"]
Jul 10 19:11:17.672690 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.672672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnq4f\" (UniqueName: \"kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f\") pod \"12c650c3-305e-42ac-b2d3-08ca0546abdb\" (UID: \"12c650c3-305e-42ac-b2d3-08ca0546abdb\") "
Jul 10 19:11:17.674638 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.674610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f" (OuterVolumeSpecName: "kube-api-access-cnq4f") pod "12c650c3-305e-42ac-b2d3-08ca0546abdb" (UID: "12c650c3-305e-42ac-b2d3-08ca0546abdb"). InnerVolumeSpecName "kube-api-access-cnq4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:17.773396 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.773314    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnq4f\" (UniqueName: \"kubernetes.io/projected/12c650c3-305e-42ac-b2d3-08ca0546abdb-kube-api-access-cnq4f\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:17.818102 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.818074    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:17.818475 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.818464    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c650c3-305e-42ac-b2d3-08ca0546abdb" containerName="test-curl-7367-139972876094640"
Jul 10 19:11:17.818529 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.818477    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c650c3-305e-42ac-b2d3-08ca0546abdb" containerName="test-curl-7367-139972876094640"
Jul 10 19:11:17.818574 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.818565    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c650c3-305e-42ac-b2d3-08ca0546abdb" containerName="test-curl-7367-139972876094640"
Jul 10 19:11:17.821495 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.821479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:17.825158 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.825134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:17.873938 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.873905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtz7s\" (UniqueName: \"kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s\") pod \"test-curl-7367-139972880131968\" (UID: \"f24567ac-d77a-4c39-96b2-e1fafa00a632\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:17.974749 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.974707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtz7s\" (UniqueName: \"kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s\") pod \"test-curl-7367-139972880131968\" (UID: \"f24567ac-d77a-4c39-96b2-e1fafa00a632\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:17.983431 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:17.983403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtz7s\" (UniqueName: \"kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s\") pod \"test-curl-7367-139972880131968\" (UID: \"f24567ac-d77a-4c39-96b2-e1fafa00a632\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:18.131462 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:18.131428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:18.266160 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:18.266139    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:18.268911 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:18.268884    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf24567ac_d77a_4c39_96b2_e1fafa00a632.slice/crio-b34099c0c33d9b555c0fa4683053d058a9e05781cb299a8894e2d57db5919d94 WatchSource:0}: Error finding container b34099c0c33d9b555c0fa4683053d058a9e05781cb299a8894e2d57db5919d94: Status 404 returned error can't find the container with id b34099c0c33d9b555c0fa4683053d058a9e05781cb299a8894e2d57db5919d94
Jul 10 19:11:18.487927 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:18.487842    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:18.487927 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:18.487891    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2177a64d0918249d0ff7afe0ee7451f396fe1505e55ae4e6cb82f26ea493bdfb"
Jul 10 19:11:18.489194 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:18.489171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880131968" event={"ID":"f24567ac-d77a-4c39-96b2-e1fafa00a632","Type":"ContainerStarted","Data":"b34099c0c33d9b555c0fa4683053d058a9e05781cb299a8894e2d57db5919d94"}
Jul 10 19:11:18.497862 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:11:18.497838    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7367-139972876094640\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="12c650c3-305e-42ac-b2d3-08ca0546abdb" pod="openshift-ingress/test-curl-7367-139972876094640"
Jul 10 19:11:19.252801 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:19.252769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c650c3-305e-42ac-b2d3-08ca0546abdb" path="/var/lib/kubelet/pods/12c650c3-305e-42ac-b2d3-08ca0546abdb/volumes"
Jul 10 19:11:19.495125 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:19.495094    2580 generic.go:356] "Generic (PLEG): container finished" podID="f24567ac-d77a-4c39-96b2-e1fafa00a632" containerID="39be7f63f860ed8668e9d1f8e9eb77d8f268f14b633c2caef2cb71fd83e81535" exitCode=0
Jul 10 19:11:19.495293 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:19.495158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880131968" event={"ID":"f24567ac-d77a-4c39-96b2-e1fafa00a632","Type":"ContainerDied","Data":"39be7f63f860ed8668e9d1f8e9eb77d8f268f14b633c2caef2cb71fd83e81535"}
Jul 10 19:11:20.646666 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.646641    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:20.665710 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.665682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7367-139972880131968_f24567ac-d77a-4c39-96b2-e1fafa00a632/test-curl-7367-139972880131968/0.log"
Jul 10 19:11:20.689798 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.689766    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:20.692287 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.692259    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:20.693264 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.693246    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtz7s\" (UniqueName: \"kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s\") pod \"f24567ac-d77a-4c39-96b2-e1fafa00a632\" (UID: \"f24567ac-d77a-4c39-96b2-e1fafa00a632\") "
Jul 10 19:11:20.695266 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.695239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s" (OuterVolumeSpecName: "kube-api-access-dtz7s") pod "f24567ac-d77a-4c39-96b2-e1fafa00a632" (UID: "f24567ac-d77a-4c39-96b2-e1fafa00a632"). InnerVolumeSpecName "kube-api-access-dtz7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:20.794418 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.794392    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtz7s\" (UniqueName: \"kubernetes.io/projected/f24567ac-d77a-4c39-96b2-e1fafa00a632-kube-api-access-dtz7s\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:20.803573 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.803544    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:20.803962 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.803948    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f24567ac-d77a-4c39-96b2-e1fafa00a632" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:20.804005 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.803962    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24567ac-d77a-4c39-96b2-e1fafa00a632" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:20.804082 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.804031    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f24567ac-d77a-4c39-96b2-e1fafa00a632" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:20.807089 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.807072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:20.813600 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.813572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:20.895320 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.895280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb7bx\" (UniqueName: \"kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx\") pod \"test-curl-7367-139972880131968\" (UID: \"6dd3ff1a-8e89-462d-8167-926d582d2e7b\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:20.996336 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:20.996308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7bx\" (UniqueName: \"kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx\") pod \"test-curl-7367-139972880131968\" (UID: \"6dd3ff1a-8e89-462d-8167-926d582d2e7b\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:21.004139 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.004117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7bx\" (UniqueName: \"kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx\") pod \"test-curl-7367-139972880131968\" (UID: \"6dd3ff1a-8e89-462d-8167-926d582d2e7b\") " pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:21.117530 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.117451    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:21.249747 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:21.249713    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dd3ff1a_8e89_462d_8167_926d582d2e7b.slice/crio-3acc226f615af64536d1f8adbc04d51b10f5f4363ccbd8332d2276bf1bdf208d WatchSource:0}: Error finding container 3acc226f615af64536d1f8adbc04d51b10f5f4363ccbd8332d2276bf1bdf208d: Status 404 returned error can't find the container with id 3acc226f615af64536d1f8adbc04d51b10f5f4363ccbd8332d2276bf1bdf208d
Jul 10 19:11:21.254154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.254112    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f24567ac-d77a-4c39-96b2-e1fafa00a632" path="/var/lib/kubelet/pods/f24567ac-d77a-4c39-96b2-e1fafa00a632/volumes"
Jul 10 19:11:21.254515 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.254501    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:21.512769 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.512661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880131968" event={"ID":"6dd3ff1a-8e89-462d-8167-926d582d2e7b","Type":"ContainerStarted","Data":"3acc226f615af64536d1f8adbc04d51b10f5f4363ccbd8332d2276bf1bdf208d"}
Jul 10 19:11:21.513958 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.513918    2580 scope.go:117] "RemoveContainer" containerID="39be7f63f860ed8668e9d1f8e9eb77d8f268f14b633c2caef2cb71fd83e81535"
Jul 10 19:11:21.514109 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:21.513942    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:22.521144 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:22.521108    2580 generic.go:356] "Generic (PLEG): container finished" podID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" containerID="8ccc302972021c9335c5381723b847b04adab0c85ca7ef37f35b23c0e4fe1b4d" exitCode=0
Jul 10 19:11:22.521559 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:22.521193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880131968" event={"ID":"6dd3ff1a-8e89-462d-8167-926d582d2e7b","Type":"ContainerDied","Data":"8ccc302972021c9335c5381723b847b04adab0c85ca7ef37f35b23c0e4fe1b4d"}
Jul 10 19:11:23.671089 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.671064    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:23.691455 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.691429    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7367-139972880131968_6dd3ff1a-8e89-462d-8167-926d582d2e7b/test-curl-7367-139972880131968/0.log"
Jul 10 19:11:23.714407 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.714377    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:23.720461 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.720438    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7367-139972880131968"]
Jul 10 19:11:23.723579 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.723553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb7bx\" (UniqueName: \"kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx\") pod \"6dd3ff1a-8e89-462d-8167-926d582d2e7b\" (UID: \"6dd3ff1a-8e89-462d-8167-926d582d2e7b\") "
Jul 10 19:11:23.725607 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.725583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx" (OuterVolumeSpecName: "kube-api-access-rb7bx") pod "6dd3ff1a-8e89-462d-8167-926d582d2e7b" (UID: "6dd3ff1a-8e89-462d-8167-926d582d2e7b"). InnerVolumeSpecName "kube-api-access-rb7bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:23.825240 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.825211    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb7bx\" (UniqueName: \"kubernetes.io/projected/6dd3ff1a-8e89-462d-8167-926d582d2e7b-kube-api-access-rb7bx\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:23.835798 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.835770    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7367-139972880132976"]
Jul 10 19:11:23.836210 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.836196    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:23.836254 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.836212    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:23.836286 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.836279    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" containerName="test-curl-7367-139972880131968"
Jul 10 19:11:23.839277 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.839262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:23.844610 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.844589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880132976"]
Jul 10 19:11:23.926383 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:23.926344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdvxj\" (UniqueName: \"kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj\") pod \"test-curl-7367-139972880132976\" (UID: \"6b894582-286c-41a2-af4b-f4c5faeeea15\") " pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:24.027405 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.027371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdvxj\" (UniqueName: \"kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj\") pod \"test-curl-7367-139972880132976\" (UID: \"6b894582-286c-41a2-af4b-f4c5faeeea15\") " pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:24.035253 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.035229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdvxj\" (UniqueName: \"kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj\") pod \"test-curl-7367-139972880132976\" (UID: \"6b894582-286c-41a2-af4b-f4c5faeeea15\") " pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:24.149772 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.149689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:24.280564 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.280539    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7367-139972880132976"]
Jul 10 19:11:24.282808 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:24.282784    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b894582_286c_41a2_af4b_f4c5faeeea15.slice/crio-b5f1b9c53e1b062fa991f380e46d28cf1b5983917c8a49b866db63c31b67acd8 WatchSource:0}: Error finding container b5f1b9c53e1b062fa991f380e46d28cf1b5983917c8a49b866db63c31b67acd8: Status 404 returned error can't find the container with id b5f1b9c53e1b062fa991f380e46d28cf1b5983917c8a49b866db63c31b67acd8
Jul 10 19:11:24.533314 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.533217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880132976" event={"ID":"6b894582-286c-41a2-af4b-f4c5faeeea15","Type":"ContainerStarted","Data":"b5f1b9c53e1b062fa991f380e46d28cf1b5983917c8a49b866db63c31b67acd8"}
Jul 10 19:11:24.534445 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.534419    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3acc226f615af64536d1f8adbc04d51b10f5f4363ccbd8332d2276bf1bdf208d"
Jul 10 19:11:24.534445 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:24.534445    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:24.544570 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:11:24.544544    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7367-139972880131968\" is forbidden: User \"system:node:ip-10-0-139-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-156.ec2.internal' and this object" podUID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" pod="openshift-ingress/test-curl-7367-139972880131968"
Jul 10 19:11:25.252751 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:25.252707    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd3ff1a-8e89-462d-8167-926d582d2e7b" path="/var/lib/kubelet/pods/6dd3ff1a-8e89-462d-8167-926d582d2e7b/volumes"
Jul 10 19:11:25.540764 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:25.540729    2580 generic.go:356] "Generic (PLEG): container finished" podID="6b894582-286c-41a2-af4b-f4c5faeeea15" containerID="8f30097a27dd40d4fef148aa7dda348672e3f314f8d2c3e4a5a50111639c59da" exitCode=0
Jul 10 19:11:25.540969 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:25.540801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7367-139972880132976" event={"ID":"6b894582-286c-41a2-af4b-f4c5faeeea15","Type":"ContainerDied","Data":"8f30097a27dd40d4fef148aa7dda348672e3f314f8d2c3e4a5a50111639c59da"}
Jul 10 19:11:26.696533 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.696506    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:26.715957 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.715931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7367-139972880132976_6b894582-286c-41a2-af4b-f4c5faeeea15/test-curl-7367-139972880132976/0.log"
Jul 10 19:11:26.740604 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.740571    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7367-139972880132976"]
Jul 10 19:11:26.744344 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.744323    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7367-139972880132976"]
Jul 10 19:11:26.754345 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.754326    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdvxj\" (UniqueName: \"kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj\") pod \"6b894582-286c-41a2-af4b-f4c5faeeea15\" (UID: \"6b894582-286c-41a2-af4b-f4c5faeeea15\") "
Jul 10 19:11:26.756337 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.756310    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj" (OuterVolumeSpecName: "kube-api-access-hdvxj") pod "6b894582-286c-41a2-af4b-f4c5faeeea15" (UID: "6b894582-286c-41a2-af4b-f4c5faeeea15"). InnerVolumeSpecName "kube-api-access-hdvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:26.856078 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:26.855974    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdvxj\" (UniqueName: \"kubernetes.io/projected/6b894582-286c-41a2-af4b-f4c5faeeea15-kube-api-access-hdvxj\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:27.252385 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:27.252306    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b894582-286c-41a2-af4b-f4c5faeeea15" path="/var/lib/kubelet/pods/6b894582-286c-41a2-af4b-f4c5faeeea15/volumes"
Jul 10 19:11:27.551564 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:27.551534    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7367-139972880132976"
Jul 10 19:11:27.551718 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:27.551585    2580 scope.go:117] "RemoveContainer" containerID="8f30097a27dd40d4fef148aa7dda348672e3f314f8d2c3e4a5a50111639c59da"
Jul 10 19:11:30.642965 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.642926    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:11:30.643438 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.643196    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" podUID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" containerName="maas-api" containerID="cri-o://8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823" gracePeriod=30
Jul 10 19:11:30.895637 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.895576    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:11:30.993015 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.992975    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh7kw\" (UniqueName: \"kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw\") pod \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") "
Jul 10 19:11:30.993216 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.993100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") pod \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") "
Jul 10 19:11:30.993216 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.993127    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca\") pod \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\" (UID: \"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13\") "
Jul 10 19:11:30.993556 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.993532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" (UID: "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:11:30.995078 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.995052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw" (OuterVolumeSpecName: "kube-api-access-fh7kw") pod "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" (UID: "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13"). InnerVolumeSpecName "kube-api-access-fh7kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:30.995135 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:30.995098    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" (UID: "b7d7dbc7-cc1a-48bc-ae07-ff728017fc13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:11:31.100675 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.094880    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh7kw\" (UniqueName: \"kubernetes.io/projected/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-kube-api-access-fh7kw\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:31.100675 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.094921    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:31.100675 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.094936    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:31.574276 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.574243    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" containerID="8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823" exitCode=0
Jul 10 19:11:31.574489 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.574283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" event={"ID":"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13","Type":"ContainerDied","Data":"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"}
Jul 10 19:11:31.574489 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.574304    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"
Jul 10 19:11:31.574489 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.574334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc" event={"ID":"b7d7dbc7-cc1a-48bc-ae07-ff728017fc13","Type":"ContainerDied","Data":"26da1f8bc0468d22e879d8c57133c64833704751a8a089d80762da628eda04fa"}
Jul 10 19:11:31.574489 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.574357    2580 scope.go:117] "RemoveContainer" containerID="8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"
Jul 10 19:11:31.583485 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.583466    2580 scope.go:117] "RemoveContainer" containerID="8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"
Jul 10 19:11:31.583744 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:11:31.583724    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823\": container with ID starting with 8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823 not found: ID does not exist" containerID="8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"
Jul 10 19:11:31.583795 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.583754    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823"} err="failed to get container status \"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823\": rpc error: code = NotFound desc = could not find container \"8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823\": container with ID starting with 8e493cd34780a282f5f6a85816511325734bba8e5bc68d29439fbc046b785823 not found: ID does not exist"
Jul 10 19:11:31.597467 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.597443    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:11:31.603075 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:31.603051    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-33ca20-5bf6b4896d-7xdfc"]
Jul 10 19:11:33.253070 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:33.253018    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" path="/var/lib/kubelet/pods/b7d7dbc7-cc1a-48bc-ae07-ff728017fc13/volumes"
Jul 10 19:11:37.553260 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.553223    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:11:37.553722 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.553479    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" podUID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" containerName="maas-api" containerID="cri-o://454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb" gracePeriod=30
Jul 10 19:11:37.804379 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.804324    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:11:37.856984 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.856953    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca\") pod \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") "
Jul 10 19:11:37.857144 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.857009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls\") pod \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") "
Jul 10 19:11:37.857144 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.857090    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4h2x\" (UniqueName: \"kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x\") pod \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\" (UID: \"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb\") "
Jul 10 19:11:37.857359 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.857336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" (UID: "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:11:37.859134 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.859104    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" (UID: "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:11:37.859247 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.859159    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x" (OuterVolumeSpecName: "kube-api-access-b4h2x") pod "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" (UID: "81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb"). InnerVolumeSpecName "kube-api-access-b4h2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:37.957825 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.957788    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-openshift-service-ca\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:37.957825 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.957817    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-maas-api-tls\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:37.957825 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:37.957826    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4h2x\" (UniqueName: \"kubernetes.io/projected/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb-kube-api-access-b4h2x\") on node \"ip-10-0-139-156.ec2.internal\" DevicePath \"\""
Jul 10 19:11:38.615344 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.615306    2580 generic.go:356] "Generic (PLEG): container finished" podID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" containerID="454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb" exitCode=0
Jul 10 19:11:38.615785 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.615348    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"
Jul 10 19:11:38.615785 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.615392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" event={"ID":"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb","Type":"ContainerDied","Data":"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"}
Jul 10 19:11:38.615785 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.615441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb" event={"ID":"81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb","Type":"ContainerDied","Data":"105ded09d55cc58b00d3ea62827036d5bd16c5fd21a041f9241241e4d58def8e"}
Jul 10 19:11:38.615785 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.615466    2580 scope.go:117] "RemoveContainer" containerID="454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"
Jul 10 19:11:38.625305 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.625285    2580 scope.go:117] "RemoveContainer" containerID="454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"
Jul 10 19:11:38.625580 ip-10-0-139-156 kubenswrapper[2580]: E0710 19:11:38.625557    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb\": container with ID starting with 454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb not found: ID does not exist" containerID="454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"
Jul 10 19:11:38.625623 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.625589    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb"} err="failed to get container status \"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb\": rpc error: code = NotFound desc = could not find container \"454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb\": container with ID starting with 454e69c21ebed045da6579121462d3c480cc471484d58d494cef5238c1f71abb not found: ID does not exist"
Jul 10 19:11:38.636094 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.636069    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:11:38.639890 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:38.639869    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b46a3-7d87579668-fh8xb"]
Jul 10 19:11:39.252616 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:39.252582    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" path="/var/lib/kubelet/pods/81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb/volumes"
Jul 10 19:11:44.029930 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:44.029893    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857885d594-549nz_efbfa798-0120-4d12-8fdc-03dd6e0c9834/authorino/0.log"
Jul 10 19:11:48.772631 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:48.772594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-865c7ddc8b-45tjj_98468bee-7e9b-428b-9c86-6cced6bd3cda/manager/0.log"
Jul 10 19:11:49.104025 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:49.103995    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v_05840596-8691-47cf-b3e0-df2992840467/copy-manifests/0.log"
Jul 10 19:11:49.110283 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:49.110256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v_05840596-8691-47cf-b3e0-df2992840467/manager/0.log"
Jul 10 19:11:49.685184 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:49.685129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5647dfbb5b-c4kvz_f6a66781-6d3e-41ac-a03f-10053485e43d/maas-api/0.log"
Jul 10 19:11:49.792198 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:49.792165    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r78sp_8ad73afd-db57-49dd-9ea1-14ef98f54a19/postgres/0.log"
Jul 10 19:11:50.992379 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:50.992345    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857885d594-549nz_efbfa798-0120-4d12-8fdc-03dd6e0c9834/authorino/0.log"
Jul 10 19:11:52.475083 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:52.474996    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d88546674-qvn8m_5b319cd1-506c-47e7-9dea-0bba65aff8d4/kube-auth-proxy/0.log"
Jul 10 19:11:52.814721 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:52.814677    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4jnqd_4495eed0-5f28-496f-a227-405cf70aa10f/payload-processing/0.log"
Jul 10 19:11:53.372980 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:53.372952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-z6877_5400b889-c58a-484d-9c93-f58d795be13f/main/0.log"
Jul 10 19:11:53.490741 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:53.490710    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jnn2f_47b76272-3f45-4ee4-90d4-da358ec7835b/main/0.log"
Jul 10 19:11:57.201699 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.201662    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9pq4/must-gather-lphzx"]
Jul 10 19:11:57.202147 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202098    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" containerName="maas-api"
Jul 10 19:11:57.202147 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202147    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" containerName="maas-api"
Jul 10 19:11:57.202278 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202210    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" containerName="maas-api"
Jul 10 19:11:57.202278 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202218    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" containerName="maas-api"
Jul 10 19:11:57.202278 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202229    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b894582-286c-41a2-af4b-f4c5faeeea15" containerName="test-curl-7367-139972880132976"
Jul 10 19:11:57.202278 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202239    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b894582-286c-41a2-af4b-f4c5faeeea15" containerName="test-curl-7367-139972880132976"
Jul 10 19:11:57.202487 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202394    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="81af93a4-c5d4-4ba5-84a5-fc0ab1dab8cb" containerName="maas-api"
Jul 10 19:11:57.202487 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202410    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d7dbc7-cc1a-48bc-ae07-ff728017fc13" containerName="maas-api"
Jul 10 19:11:57.202487 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.202419    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b894582-286c-41a2-af4b-f4c5faeeea15" containerName="test-curl-7367-139972880132976"
Jul 10 19:11:57.207670 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.207651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.209948 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.209931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9pq4\"/\"default-dockercfg-spgnv\""
Jul 10 19:11:57.209948 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.209941    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9pq4\"/\"kube-root-ca.crt\""
Jul 10 19:11:57.210665 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.210650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9pq4\"/\"openshift-service-ca.crt\""
Jul 10 19:11:57.213335 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.213316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/must-gather-lphzx"]
Jul 10 19:11:57.248890 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.248860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8wq\" (UniqueName: \"kubernetes.io/projected/7971e99f-5863-426d-b368-21a06ab57911-kube-api-access-5j8wq\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.249094 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.249008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7971e99f-5863-426d-b368-21a06ab57911-must-gather-output\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.350499 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.350457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8wq\" (UniqueName: \"kubernetes.io/projected/7971e99f-5863-426d-b368-21a06ab57911-kube-api-access-5j8wq\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.350684 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.350541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7971e99f-5863-426d-b368-21a06ab57911-must-gather-output\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.350826 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.350810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7971e99f-5863-426d-b368-21a06ab57911-must-gather-output\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.362745 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.362714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8wq\" (UniqueName: \"kubernetes.io/projected/7971e99f-5863-426d-b368-21a06ab57911-kube-api-access-5j8wq\") pod \"must-gather-lphzx\" (UID: \"7971e99f-5863-426d-b368-21a06ab57911\") " pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.518628 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.518537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/must-gather-lphzx"
Jul 10 19:11:57.654343 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.654313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/must-gather-lphzx"]
Jul 10 19:11:57.656612 ip-10-0-139-156 kubenswrapper[2580]: W0710 19:11:57.656585    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7971e99f_5863_426d_b368_21a06ab57911.slice/crio-a2e8b472375c31f7ddafd8957ea17f79af4c38cdfb4983b9fd1a66bdeaf96d35 WatchSource:0}: Error finding container a2e8b472375c31f7ddafd8957ea17f79af4c38cdfb4983b9fd1a66bdeaf96d35: Status 404 returned error can't find the container with id a2e8b472375c31f7ddafd8957ea17f79af4c38cdfb4983b9fd1a66bdeaf96d35
Jul 10 19:11:57.717449 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:57.717406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/must-gather-lphzx" event={"ID":"7971e99f-5863-426d-b368-21a06ab57911","Type":"ContainerStarted","Data":"a2e8b472375c31f7ddafd8957ea17f79af4c38cdfb4983b9fd1a66bdeaf96d35"}
Jul 10 19:11:58.728230 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:58.728184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/must-gather-lphzx" event={"ID":"7971e99f-5863-426d-b368-21a06ab57911","Type":"ContainerStarted","Data":"f26bb5e7608e771c793df618e230f7eda24370088bb20fd6842a57c7e0c9093c"}
Jul 10 19:11:58.728613 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:58.728251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/must-gather-lphzx" event={"ID":"7971e99f-5863-426d-b368-21a06ab57911","Type":"ContainerStarted","Data":"5bbe2ca5bcd05f7fce6c0f8997c7f7c53da586f1126fe54a1ba392c36690c925"}
Jul 10 19:11:58.746982 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:11:58.746882    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9pq4/must-gather-lphzx" podStartSLOduration=0.908097764 podStartE2EDuration="1.746864957s" totalImagesPullingTime="838.767193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:11:58.7454723 +0000 UTC m=+2518.128800566" watchObservedRunningTime="2026-07-10 19:11:58.746864957 +0000 UTC m=+2518.130193210"
Jul 10 19:12:00.219603 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:00.219573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tfxs4_aea19769-654d-4b21-b2c3-2b8731eaaf50/global-pull-secret-syncer/0.log"
Jul 10 19:12:00.340496 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:00.340454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pt6cr_7c5ef660-5cfe-4a2c-af6e-c6562d53389d/konnectivity-agent/0.log"
Jul 10 19:12:00.364609 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:00.364579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-156.ec2.internal_e10b4f2e152136f6a48aa6426e23a3c5/haproxy/0.log"
Jul 10 19:12:05.603061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:05.602755    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857885d594-549nz_efbfa798-0120-4d12-8fdc-03dd6e0c9834/authorino/0.log"
Jul 10 19:12:07.786606 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.786531    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/alertmanager/0.log"
Jul 10 19:12:07.811088 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.811030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/config-reloader/0.log"
Jul 10 19:12:07.833267 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.833191    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/kube-rbac-proxy-web/0.log"
Jul 10 19:12:07.857303 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.857219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/kube-rbac-proxy/0.log"
Jul 10 19:12:07.880335 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.880252    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/kube-rbac-proxy-metric/0.log"
Jul 10 19:12:07.906547 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.906521    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/prom-label-proxy/0.log"
Jul 10 19:12:07.927415 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.927384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1447c-35b2-4b82-b39b-41892a0541b0/init-config-reloader/0.log"
Jul 10 19:12:07.993532 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:07.993506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-state-metrics/0.log"
Jul 10 19:12:08.012677 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.012645    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-rbac-proxy-main/0.log"
Jul 10 19:12:08.033591 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.033558    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-x6d8j_68d8dee9-eee8-4286-95e1-ef77cd05fad8/kube-rbac-proxy-self/0.log"
Jul 10 19:12:08.062759 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.062723    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f88d87764-mlf6d_89308245-46b2-405f-a114-6bef55e6e38d/metrics-server/0.log"
Jul 10 19:12:08.086984 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.086956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-kpsxq_cad69796-7ca8-4c98-8c11-4bb681878fab/monitoring-plugin/0.log"
Jul 10 19:12:08.284939 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.284907    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/node-exporter/0.log"
Jul 10 19:12:08.305181 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.305144    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/kube-rbac-proxy/0.log"
Jul 10 19:12:08.326769 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.326746    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwkng_9159a9c3-4ec6-45e4-84f0-e149418ca497/init-textfile/0.log"
Jul 10 19:12:08.359636 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.359605    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/kube-rbac-proxy-main/0.log"
Jul 10 19:12:08.379340 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.379309    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/kube-rbac-proxy-self/0.log"
Jul 10 19:12:08.401871 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.401842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jvgqf_b490ab7e-a234-4dcf-a20a-ca1f5d37f2aa/openshift-state-metrics/0.log"
Jul 10 19:12:08.440183 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.440150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/prometheus/0.log"
Jul 10 19:12:08.461591 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.461449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/config-reloader/0.log"
Jul 10 19:12:08.483290 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.483246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/thanos-sidecar/0.log"
Jul 10 19:12:08.504884 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.504846    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/kube-rbac-proxy-web/0.log"
Jul 10 19:12:08.532315 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.532290    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/kube-rbac-proxy/0.log"
Jul 10 19:12:08.553000 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.552967    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/kube-rbac-proxy-thanos/0.log"
Jul 10 19:12:08.574311 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.574279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a64da33-ae67-482f-8126-9cba94c2d4a6/init-config-reloader/0.log"
Jul 10 19:12:08.608325 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.608293    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gplk5_fc245db1-f00b-40a2-8f13-1092607c45c6/prometheus-operator/0.log"
Jul 10 19:12:08.625557 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.625506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gplk5_fc245db1-f00b-40a2-8f13-1092607c45c6/kube-rbac-proxy/0.log"
Jul 10 19:12:08.682257 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.682224    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/telemeter-client/0.log"
Jul 10 19:12:08.703905 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.703880    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/reload/0.log"
Jul 10 19:12:08.724654 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.724559    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798fd8d4b-stbkz_9551c57c-f5ba-4909-9ee6-8cc91be51963/kube-rbac-proxy/0.log"
Jul 10 19:12:08.770787 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.770755    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/thanos-query/0.log"
Jul 10 19:12:08.790929 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.790891    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-web/0.log"
Jul 10 19:12:08.810890 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.810862    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy/0.log"
Jul 10 19:12:08.830237 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.830208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/prom-label-proxy/0.log"
Jul 10 19:12:08.850910 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.850877    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-rules/0.log"
Jul 10 19:12:08.873237 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:08.873211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74547b45-4c8n7_f9840015-a21f-4f1f-b994-2319233e1c14/kube-rbac-proxy-metrics/0.log"
Jul 10 19:12:09.977304 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:09.977271    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"]
Jul 10 19:12:09.985215 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:09.985189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:09.995550 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:09.995453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"]
Jul 10 19:12:10.080949 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.080902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-proc\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.081154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.080994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-lib-modules\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.081154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.081079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fhp9\" (UniqueName: \"kubernetes.io/projected/7b8e5511-4d49-4719-8bcd-f31831a3f015-kube-api-access-4fhp9\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.081154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.081112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-podres\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.081154 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.081135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-sys\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.182642 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fhp9\" (UniqueName: \"kubernetes.io/projected/7b8e5511-4d49-4719-8bcd-f31831a3f015-kube-api-access-4fhp9\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.182824 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-podres\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.182824 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-sys\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.182824 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-proc\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.182824 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-lib-modules\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.183061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-podres\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.183061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-proc\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.183061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-lib-modules\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.183061 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.182869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b8e5511-4d49-4719-8bcd-f31831a3f015-sys\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.191846 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.191817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fhp9\" (UniqueName: \"kubernetes.io/projected/7b8e5511-4d49-4719-8bcd-f31831a3f015-kube-api-access-4fhp9\") pod \"perf-node-gather-daemonset-kzlql\" (UID: \"7b8e5511-4d49-4719-8bcd-f31831a3f015\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.299986 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.299946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.495286 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.495206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"]
Jul 10 19:12:10.828264 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.828165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql" event={"ID":"7b8e5511-4d49-4719-8bcd-f31831a3f015","Type":"ContainerStarted","Data":"055f06b302f54ba1b8cd60014ce7846c63c07081e183b58cec9f7eb53eaa27bf"}
Jul 10 19:12:10.828445 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.828266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql" event={"ID":"7b8e5511-4d49-4719-8bcd-f31831a3f015","Type":"ContainerStarted","Data":"995b1aa306f308898143c03f426f575faa5a8a5d9457de1953f7280de2e076d1"}
Jul 10 19:12:10.829119 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.829093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:10.847132 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:10.846951    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql" podStartSLOduration=1.8469324089999999 podStartE2EDuration="1.846932409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:12:10.843892808 +0000 UTC m=+2530.227221063" watchObservedRunningTime="2026-07-10 19:12:10.846932409 +0000 UTC m=+2530.230260663"
Jul 10 19:12:12.785200 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:12.785168    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4w7mf_dec505ca-b6d6-498f-85ca-0bd47c9c0f63/dns/0.log"
Jul 10 19:12:12.805742 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:12.805712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4w7mf_dec505ca-b6d6-498f-85ca-0bd47c9c0f63/kube-rbac-proxy/0.log"
Jul 10 19:12:12.947971 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:12.947940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9jx6q_3992f5eb-7054-449e-87c0-d7a51280584f/dns-node-resolver/0.log"
Jul 10 19:12:13.562788 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:13.562728    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h9n9l_6b16e31c-7f91-4824-8852-8b085a778689/node-ca/0.log"
Jul 10 19:12:14.621289 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:14.621261    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d88546674-qvn8m_5b319cd1-506c-47e7-9dea-0bba65aff8d4/kube-auth-proxy/0.log"
Jul 10 19:12:14.785473 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:14.785447    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4jnqd_4495eed0-5f28-496f-a227-405cf70aa10f/payload-processing/0.log"
Jul 10 19:12:15.592780 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:15.592741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j6swc_7f9323ae-6984-4ace-b753-c82abf786b87/serve-healthcheck-canary/0.log"
Jul 10 19:12:16.372523 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:16.372498    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7q6_39eadf52-2263-4b29-aa36-05d41d3ef7fc/kube-rbac-proxy/0.log"
Jul 10 19:12:16.395721 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:16.395675    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7q6_39eadf52-2263-4b29-aa36-05d41d3ef7fc/exporter/0.log"
Jul 10 19:12:16.418824 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:16.418793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7q6_39eadf52-2263-4b29-aa36-05d41d3ef7fc/extractor/0.log"
Jul 10 19:12:17.852678 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:17.852652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-kzlql"
Jul 10 19:12:19.258543 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:19.258461    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-865c7ddc8b-45tjj_98468bee-7e9b-428b-9c86-6cced6bd3cda/manager/0.log"
Jul 10 19:12:19.427228 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:19.427136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v_05840596-8691-47cf-b3e0-df2992840467/manager/0.log"
Jul 10 19:12:19.449655 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:19.449626    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-flv6v_05840596-8691-47cf-b3e0-df2992840467/copy-manifests/0.log"
Jul 10 19:12:20.700515 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:20.700487    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d88546674-qvn8m_5b319cd1-506c-47e7-9dea-0bba65aff8d4/kube-auth-proxy/0.log"
Jul 10 19:12:20.837023 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:20.836986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4jnqd_4495eed0-5f28-496f-a227-405cf70aa10f/payload-processing/0.log"
Jul 10 19:12:20.876720 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:20.876682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c6cfb7f55-nqdpf_9a30a818-f3bd-4145-9238-900c8c89fb53/manager/0.log"
Jul 10 19:12:22.234290 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:22.234255    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d88546674-qvn8m_5b319cd1-506c-47e7-9dea-0bba65aff8d4/kube-auth-proxy/0.log"
Jul 10 19:12:22.374213 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:22.374184    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4jnqd_4495eed0-5f28-496f-a227-405cf70aa10f/payload-processing/0.log"
Jul 10 19:12:27.292856 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.292826    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/kube-multus-additional-cni-plugins/0.log"
Jul 10 19:12:27.318254 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.318220    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/egress-router-binary-copy/0.log"
Jul 10 19:12:27.339523 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.339481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/cni-plugins/0.log"
Jul 10 19:12:27.361620 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.361583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/bond-cni-plugin/0.log"
Jul 10 19:12:27.381810 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.381790    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/routeoverride-cni/0.log"
Jul 10 19:12:27.402498 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.402469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/whereabouts-cni-bincopy/0.log"
Jul 10 19:12:27.423530 ip-10-0-139-156 kubenswrapper[2580]: I0710 19:12:27.423503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hgmnm_b432f3ec-7e15-4e3c-9169-e4119bd4c6f2/whereabouts-cni/0.log"