Jul 13 17:05:30.118381 ip-10-0-138-241 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 17:05:30.709588 ip-10-0-138-241 systemd[1]: Started Kubernetes Kubelet.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.615780    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620343    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620357    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620361    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620364    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620367    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620370    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620373    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:30.718741 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620376    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620379    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620382    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620385    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620388    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620391    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620394    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620397    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620400    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620403    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620407    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620410    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620412    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620415    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620418    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620420    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620423    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620426    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620428    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:30.720427 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620431    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620435    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620439    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620442    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620445    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620448    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620452    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620456    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620459    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620462    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620465    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620467    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620470    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620473    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620475    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620478    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620481    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620484    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620487    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:30.722880 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620490    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620494    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620496    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620499    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620502    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620504    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620508    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620511    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620514    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620516    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620519    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620522    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620524    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620527    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620529    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620532    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620535    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620537    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620540    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620542    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:30.723804 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620545    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620548    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620551    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620553    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620556    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620559    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620561    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620564    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620567    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620570    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620573    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620576    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620579    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620582    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620584    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620587    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620589    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620593    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620596    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620598    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:30.725222 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620601    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620604    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620606    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620609    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620611    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620614    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620617    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620619    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620622    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620626    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620629    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620632    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620636    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.620638    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621368    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621376    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621379    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621382    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621385    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621389    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:30.726374 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621391    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621394    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621397    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621400    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621403    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621406    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621409    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621411    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621414    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621417    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621421    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621425    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621428    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621430    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621433    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621437    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621441    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621444    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621448    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:30.727879 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621451    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621454    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621457    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621460    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621463    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621466    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621469    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621472    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621474    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621477    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621480    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621483    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621485    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621488    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621491    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621493    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621495    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621499    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621502    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:30.729035 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621505    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621507    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621510    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621512    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621515    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621519    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621522    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621525    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621527    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621531    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621534    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621537    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621540    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621543    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621547    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621549    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621553    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621555    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621558    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:30.730470 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621560    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621563    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621565    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621568    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621571    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621573    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621576    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621579    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621581    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621584    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621587    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621590    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621593    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621596    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621598    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621602    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621604    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621607    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621610    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621613    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:30.731549 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621617    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621619    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621622    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621625    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621627    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621630    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621633    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621635    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621638    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621641    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621644    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621646    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621649    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621652    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621655    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.621657    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622233    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622242    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622246    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622251    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:30.732956 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622255    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622259    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622262    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622266    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622278    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622282    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622286    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622290    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622294    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622298    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622302    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622305    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622309    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622313    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622316    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622321    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622325    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622329    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622333    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622337    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622341    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:30.734330 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622345    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622352    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622356    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622360    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622364    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622368    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622372    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622375    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622379    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622383    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622387    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622390    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622394    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622398    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622403    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622407    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622411    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622415    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622419    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622423    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:30.737127 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622427    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622430    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622434    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622438    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622444    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622448    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622452    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622456    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622460    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622464    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622468    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622472    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622476    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622482    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622487    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622492    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622497    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622501    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622507    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:30.738458 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622512    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622516    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622519    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622523    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622527    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622531    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622535    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622539    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622543    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622547    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622552    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622556    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622559    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622563    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622567    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622570    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622576    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622581    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622585    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622589    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:30.893584 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622592    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622596    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622600    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622604    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622608    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622612    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622616    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622622    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622627    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622631    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622636    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622640    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622644    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622648    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.622651    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622745    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622765    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622773    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622780    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622786    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 17:05:30.916245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622791    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622797    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622803    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622810    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622815    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622820    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622823    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622826    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622830    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622836    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622840    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622844    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622848    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622855    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622859    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622863    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622868    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622873    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622881    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622885    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622889    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622894    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622898    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622902    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 17:05:30.917604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622907    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622912    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622916    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622922    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622926    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622931    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622935    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622940    2567 flags.go:64] FLAG: --enable-server="true"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622944    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622950    2567 flags.go:64] FLAG: --event-burst="100"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622955    2567 flags.go:64] FLAG: --event-qps="50"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622959    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622964    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622968    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622974    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622978    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622982    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622989    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622992    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.622997    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623002    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623006    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623025    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623030    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623035    2567 flags.go:64] FLAG: --feature-gates=""
Jul 13 17:05:30.918438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623041    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623048    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623053    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623058    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623063    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623067    2567 flags.go:64] FLAG: --help="false"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623072    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623077    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623081    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623085    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623091    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623095    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623099    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623104    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623108    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623112    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623116    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623121    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623125    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623130    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623135    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623140    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623145    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623149    2567 flags.go:64] FLAG: --lock-file=""
Jul 13 17:05:30.919563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623155    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623159    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623164    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623171    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623176    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623180    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623184    2567 flags.go:64] FLAG: --logging-format="text"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623188    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623193    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623199    2567 flags.go:64] FLAG: --manifest-url=""
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623203    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623209    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623214    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623220    2567 flags.go:64] FLAG: --max-pods="110"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623225    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623229    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623233    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623238    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623243    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623246    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623250    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623261    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623265    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623270    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 17:05:30.920500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623275    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623279    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623287    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623292    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623296    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623302    2567 flags.go:64] FLAG: --port="10250"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623307    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623311    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f7d47b85b4097f65"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623317    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623322    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623326    2567 flags.go:64] FLAG: --register-node="true"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623330    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623336    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623340    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623344    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623349    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623354    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623359    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623364    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623368    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623373    2567 flags.go:64] FLAG: --runonce="false"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623377    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623381    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623386    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623390    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 17:05:30.921469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623395    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623399    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623403    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623408    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623412    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623416    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623420    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623424    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623429    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623433    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623437    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623445    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623449    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623454    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623459    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623464    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623469    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623473    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623477    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623482    2567 flags.go:64] FLAG: --v="2"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623489    2567 flags.go:64] FLAG: --version="false"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623495    2567 flags.go:64] FLAG: --vmodule=""
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623504    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.623509    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623705    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:30.922282 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623713    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623719    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623724    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623728    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623733    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623737    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623741    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623745    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623750    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623753    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623757    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623761    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623765    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623769    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623773    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623778    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623782    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623786    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623790    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623794    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:30.923359 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623798    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623803    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623808    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623812    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623816    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623819    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623823    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623827    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623830    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623834    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623838    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623844    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623850    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623855    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623859    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623864    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623868    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623871    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623875    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:30.924061 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623878    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623882    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623885    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623888    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623891    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623893    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623896    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623899    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623901    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623904    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623907    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623910    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623914    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623917    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623920    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623926    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623928    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623931    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623934    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:30.928023 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623936    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623939    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623942    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623944    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623947    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623950    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623954    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623956    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623959    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623962    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623964    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623967    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623970    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623972    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623975    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623978    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623980    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623983    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623986    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623988    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:30.928687 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623990    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623993    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623996    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.623998    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624001    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624003    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624006    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624009    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624027    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624030    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624033    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624036    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624039    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624041    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624044    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624047    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624049    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624052    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624056    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:30.929369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.624059    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.624064    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.632265    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.632280    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.633081    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.633089    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633148    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633153    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633157    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633160    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633163    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633166    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633169    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633173    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633175    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:31.128024 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633178    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633181    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633184    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633187    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633189    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633192    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633195    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633198    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633201    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633204    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633207    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633210    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633213    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633216    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633219    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633222    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633225    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633227    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633230    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633233    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:31.128821 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633236    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633239    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633241    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633244    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633246    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633249    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633252    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633254    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633257    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633259    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633262    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633265    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633267    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633270    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633272    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633275    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633277    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633280    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633282    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633285    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:31.129558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633288    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633291    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633294    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633298    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633303    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633305    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633311    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633314    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633316    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633319    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633322    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633325    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633327    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633330    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633332    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633335    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633338    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633340    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633343    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:31.130351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633346    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633348    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633351    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633354    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633356    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633359    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633361    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633364    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633369    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633372    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633375    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633378    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633380    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633383    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633390    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633394    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633397    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633400    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633403    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:31.130978 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633407    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633410    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633414    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633417    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633420    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633423    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633426    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633429    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633432    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633434    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633437    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633440    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.633445    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633580    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:05:31.131829 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633585    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633588    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633591    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633595    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633598    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633600    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633604    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633609    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633612    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633614    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633617    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633620    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633622    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633625    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633628    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633630    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633633    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633636    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633639    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633642    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:05:31.132355 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633645    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633648    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633650    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633653    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633655    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633658    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633661    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633663    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633666    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633669    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633671    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633674    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633677    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633679    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633682    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633684    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633687    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633690    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633693    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:05:31.306982 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633697    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633699    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633711    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633716    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633720    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633724    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633727    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633731    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633734    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633737    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633740    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633743    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633749    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633752    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633754    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633757    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633760    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633763    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633767    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:05:31.307882 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633770    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633773    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633776    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633780    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633782    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633785    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633788    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633791    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633793    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633796    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633798    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633801    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633803    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633807    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633810    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633813    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633815    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633818    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633820    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633823    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:05:31.313323 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633825    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633828    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633832    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633835    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633837    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633842    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633844    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633847    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633849    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633852    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633854    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633857    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633860    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633862    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633865    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633867    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633870    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633872    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633875    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:05:31.313930 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:30.633878    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.633882    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.633996    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.636028    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.637187    2567 server.go:1019] "Starting client certificate rotation"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.637285    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.637325    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.644891    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.648701    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.658327    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.660352    2567 log.go:25] "Validated CRI v1 image API"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.661285    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 17:05:31.314509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.667254    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 89e5eb33-ed5a-42cd-8f06-823b602e6bc4:/dev/nvme0n1p4 8b207ef1-8ee7-4ee7-b021-ea1e1d38d94a:/dev/nvme0n1p3]
Jul 13 17:05:31.314997 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.667273    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.672835    2567 manager.go:216] Machine: {Timestamp:2026-07-13 17:05:30.67073647 +0000 UTC m=+0.429336300 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098290 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d3be0e5943d29325fd23838f07b5 SystemUUID:ec20d3be-0e59-43d2-9325-fd23838f07b5 BootID:984320ec-c0ab-4bf4-b254-1dc4c7cbd3b5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:48:39:74:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:48:39:74:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:ca:cc:ad:f5:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.672949    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.673049    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.677782    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.679800    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.679825    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 17:05:31.315071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.680638    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.680647    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.680655    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.681456    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.687421    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690737    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690874    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690905    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690916    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690934    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690944    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.690955    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.691330    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.691348    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.694358    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wdh6"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.694845    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.697766    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.697807    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698010    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698024    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698032    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698060    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698071    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698077    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698676    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698683    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698691    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698697    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698707    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.698717    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.700001    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.700001    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.703883    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wdh6"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.704543    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.704556    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.707181    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.708339    2567 server.go:1268] "Started kubelet"
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.708429    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.708446    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 17:05:31.315433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.708514    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.709757    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.709857    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.714594    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.716362    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.716372    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.716446    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723029    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723084    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723099    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723333    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723341    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723420    2567 factory.go:55] Registering systemd factory
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723460    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723698    2567 factory.go:153] Registering CRI-O factory
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723713    2567 factory.go:223] Registration of the crio container factory successfully
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723813    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723833    2567 factory.go:103] Registering Raw factory
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.723844    2567 manager.go:1196] Started watching for new ooms in manager
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.724301    2567 manager.go:349] Starting recovery of all containers
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.734246    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.734537    2567 manager.go:354] Recovery completed
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.741759    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.744909    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.747360    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.747397    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.747409    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.748050    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.748063    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.748086    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.748066    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.749408    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.749440    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.749454    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.750022    2567 policy_none.go:49] "None policy: Start"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.750040    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.750051    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.756595    2567 policy_none.go:47] "Start"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.795698    2567 manager.go:337] "Starting Device Plugin manager"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.795732    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.795755    2567 server.go:87] "Starting device plugin registration server"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.796067    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.796110    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.796179    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 17:05:31.316624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.796280    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.796290    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.796891    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.796935    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.887076    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.888466    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.888508    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.888546    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.888586    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.894920    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.896188    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.897068    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.897102    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.897119    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.897146    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.907312    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.907332    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-241.ec2.internal\": node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:30.933231    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.992003    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"]
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.992109    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.993510    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.993544    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.993559    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.995278    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.995395    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.995424    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996161    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996192    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996209    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996216    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996234    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.996244    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.997374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.997403    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:05:31.462494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.998121    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.998142    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:30.998152    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.030027    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.030765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f4eaa5d8f91e8f1be5b963701a60942-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"3f4eaa5d8f91e8f1be5b963701a60942\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.030797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.030816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.033432    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.034778    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.131849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f4eaa5d8f91e8f1be5b963701a60942-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"3f4eaa5d8f91e8f1be5b963701a60942\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.131891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.131922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.131951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f4eaa5d8f91e8f1be5b963701a60942-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"3f4eaa5d8f91e8f1be5b963701a60942\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.132002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.131951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6264b20985fd4899343a3d66e56bac9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"6264b20985fd4899343a3d66e56bac9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.134083    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.234560    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.332687    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.464432 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.334985    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.465045 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.338232    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.465045 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.435429    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.536310 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.536279    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.637112 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.637030    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.637112 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.637053    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 17:05:31.637296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.637195    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 17:05:31.637296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.637240    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 17:05:31.709327 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.709286    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:00:31 +0000 UTC" deadline="2028-01-15 14:57:51.615366104 +0000 UTC"
Jul 13 17:05:31.709327 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.709319    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13221h52m19.906051709s"
Jul 13 17:05:31.737965 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:31.737935    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 13 17:05:31.816623 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.816590    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:31.917427 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.917332    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.925201 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.925181    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:05:31.927013 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.926998    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 13 17:05:31.936341 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.936319    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:05:31.988030 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:31.988000    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:32.315763 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:32.315724    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6264b20985fd4899343a3d66e56bac9d.slice/crio-34ed21e8f4e65dfcd09b91f2de5d7a74566419502cfcfe9fe929194b92f818a5 WatchSource:0}: Error finding container 34ed21e8f4e65dfcd09b91f2de5d7a74566419502cfcfe9fe929194b92f818a5: Status 404 returned error can't find the container with id 34ed21e8f4e65dfcd09b91f2de5d7a74566419502cfcfe9fe929194b92f818a5
Jul 13 17:05:32.321011 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.320994    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:05:32.362200 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:32.362176    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4eaa5d8f91e8f1be5b963701a60942.slice/crio-ddff6c711205ce34b8e418662e104d594de8f8897cf23029170d2d8b684701e0 WatchSource:0}: Error finding container ddff6c711205ce34b8e418662e104d594de8f8897cf23029170d2d8b684701e0: Status 404 returned error can't find the container with id ddff6c711205ce34b8e418662e104d594de8f8897cf23029170d2d8b684701e0
Jul 13 17:05:32.472740 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.472660    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:32.695167 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.695120    2567 apiserver.go:52] "Watching apiserver"
Jul 13 17:05:32.699467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.699446    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 17:05:32.701333 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.701308    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-fr9qd","openshift-multus/multus-tdzgt","openshift-network-diagnostics/network-check-target-pjng8","openshift-network-operator/iptables-alerter-hq8nk","openshift-ovn-kubernetes/ovnkube-node-tgk76","kube-system/global-pull-secret-syncer-tplfd","kube-system/konnectivity-agent-qftlq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8","openshift-cluster-node-tuning-operator/tuned-qhm6c","openshift-dns/node-resolver-tfr4b","openshift-image-registry/node-ca-xkvxj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal","openshift-multus/network-metrics-daemon-48lrl","kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"]
Jul 13 17:05:32.703098 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.703073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.704590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.704565    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.704698 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.704629    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:32.705161 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.705132    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 17:05:32.705489 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.705467    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 17:05:32.706941 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.706894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cgb22\""
Jul 13 17:05:32.707236 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.707187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:32.708186 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.707451    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:32.708186 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.708102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.709864 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.709836    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjs7z\""
Jul 13 17:05:32.710011 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.709994    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.710129 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.710107    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.710199 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.710123    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.710255 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.710120    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 17:05:32.711766 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.711748    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.711864 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.711826    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:32.712297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712146    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.712297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712151    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 17:05:32.712297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712171    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.712297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712182    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 17:05:32.712297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712221    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 17:05:32.712648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712606    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fnbwf\""
Jul 13 17:05:32.712839 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.712703    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 17:05:32.713460 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.713440    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.715050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.715023    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gcb9k\""
Jul 13 17:05:32.715179 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.715065    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.715179 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.715092    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.715179 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.715118    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.716644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.716622    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.717008 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.716990    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 17:05:32.717137 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717068    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 17:05:32.717205 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717163    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kqcv6\""
Jul 13 17:05:32.717205 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717170    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.717318 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717223    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 17:05:32.717516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717499    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 17:05:32.717516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.717510    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.718054 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.718035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.718415 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.718395    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 17:05:32.718606 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.718585    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9nfcs\""
Jul 13 17:05:32.719726 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.719707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.719816 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.719776    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7nfkq\""
Jul 13 17:05:32.719816 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.719802    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.720270 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.720250    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.721215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.721196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.721463 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.721435    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.721543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.721516    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 17:05:32.721834 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.721818    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.721893 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.721879    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-72vs6\""
Jul 13 17:05:32.723082 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.723021    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 17:05:32.723082 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.723021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-blvts\""
Jul 13 17:05:32.723222 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.723178    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 17:05:32.723222 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.723192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 17:05:32.724142 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.724127    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 17:05:32.726991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.726971    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:05:32.733699 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.733682    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:05:32.742637 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysconfig\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-sys\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742677    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/121406d1-00ed-49e7-8a20-34bc4f265c1d-serviceca\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-netns\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-bin\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-system-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-etc-selinux\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rfx9\" (UniqueName: \"kubernetes.io/projected/09b996f5-2d30-4a67-b349-c56296d7b297-kube-api-access-9rfx9\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-var-lib-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-script-lib\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-var-lib-kubelet\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.742962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-tmp-dir\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.743044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-registration-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-systemd\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-etc-tuned\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-cnibin\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-hostroot\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-conf-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-kubelet-config\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-os-release\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-cni-binary-copy\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-k8s-cni-cncf-io\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.743627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-netns\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-conf\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-socket-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743543    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzv5\" (UniqueName: \"kubernetes.io/projected/61575938-a2c4-4105-a8ad-21bde52da39e-kube-api-access-7tzv5\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-slash\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-systemd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-log-socket\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz498\" (UniqueName: \"kubernetes.io/projected/093223d9-cfe3-44b7-adae-0046482639a6-kube-api-access-kz498\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-kubelet\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-multus-certs\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmhn\" (UniqueName: \"kubernetes.io/projected/121406d1-00ed-49e7-8a20-34bc4f265c1d-kube-api-access-9hmhn\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.744047 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-etc-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-netd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-config\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743924    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-env-overrides\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-node-log\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-socket-dir-parent\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-kubelet\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.743988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb269960-6a56-4e98-8f0b-1ef412a69917-ovn-node-metrics-cert\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-lib-modules\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-tmp\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-dbus\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-etc-kubernetes\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbnh\" (UniqueName: \"kubernetes.io/projected/50619687-a54b-4fcb-a9b1-d415546bf4e4-kube-api-access-kcbnh\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744520 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-device-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-hosts-file\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/121406d1-00ed-49e7-8a20-34bc4f265c1d-host\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-run\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-cnibin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-sys-fs\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ffae37-af09-4fc7-bbe5-290183f73844-konnectivity-ca\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-multus\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-daemon-config\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-modprobe-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b996f5-2d30-4a67-b349-c56296d7b297-host-slash\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-systemd-units\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.744959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-ovn\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-kubernetes\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-host\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-bin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ffae37-af09-4fc7-bbe5-290183f73844-agent-certs\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09b996f5-2d30-4a67-b349-c56296d7b297-iptables-alerter-script\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgwt\" (UniqueName: \"kubernetes.io/projected/022617a2-2d06-422f-aaf0-012975df1739-kube-api-access-sfgwt\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dsk\" (UniqueName: \"kubernetes.io/projected/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-kube-api-access-v5dsk\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr6n2\" (UniqueName: \"kubernetes.io/projected/cb269960-6a56-4e98-8f0b-1ef412a69917-kube-api-access-rr6n2\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-os-release\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.745505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.744717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6hc\" (UniqueName: \"kubernetes.io/projected/7a08b963-67ee-4331-9f33-939660d0e2e6-kube-api-access-hw6hc\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.750347 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.750326    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtmmm"
Jul 13 17:05:32.759445 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.759427    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtmmm"
Jul 13 17:05:32.845807 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ffae37-af09-4fc7-bbe5-290183f73844-konnectivity-ca\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.845807 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-multus\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-daemon-config\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-modprobe-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b996f5-2d30-4a67-b349-c56296d7b297-host-slash\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-systemd-units\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-multus\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-systemd-units\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.845966    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b996f5-2d30-4a67-b349-c56296d7b297-host-slash\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-ovn\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.846071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-kubernetes\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-host\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-kubernetes\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-modprobe-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-host\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-ovn\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-bin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ffae37-af09-4fc7-bbe5-290183f73844-agent-certs\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-cni-bin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846226    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09b996f5-2d30-4a67-b349-c56296d7b297-iptables-alerter-script\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgwt\" (UniqueName: \"kubernetes.io/projected/022617a2-2d06-422f-aaf0-012975df1739-kube-api-access-sfgwt\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dsk\" (UniqueName: \"kubernetes.io/projected/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-kube-api-access-v5dsk\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.846526 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr6n2\" (UniqueName: \"kubernetes.io/projected/cb269960-6a56-4e98-8f0b-1ef412a69917-kube-api-access-rr6n2\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-os-release\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6hc\" (UniqueName: \"kubernetes.io/projected/7a08b963-67ee-4331-9f33-939660d0e2e6-kube-api-access-hw6hc\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-os-release\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysconfig\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846562    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-daemon-config\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.846646    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-sys\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysconfig\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.846724    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:33.346703728 +0000 UTC m=+3.105303548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:32.847287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-sys\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846774    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/121406d1-00ed-49e7-8a20-34bc4f265c1d-serviceca\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09b996f5-2d30-4a67-b349-c56296d7b297-iptables-alerter-script\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-netns\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-bin\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-system-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-netns\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846930    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ffae37-af09-4fc7-bbe5-290183f73844-konnectivity-ca\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-system-cni-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-etc-selinux\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-bin\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.847991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rfx9\" (UniqueName: \"kubernetes.io/projected/09b996f5-2d30-4a67-b349-c56296d7b297-kube-api-access-9rfx9\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.846987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-etc-selinux\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-var-lib-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-script-lib\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-var-lib-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-var-lib-kubelet\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-var-lib-kubelet\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-tmp-dir\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-registration-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-systemd\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-etc-tuned\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-registration-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-cnibin\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.848663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847281    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/121406d1-00ed-49e7-8a20-34bc4f265c1d-serviceca\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-hostroot\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-cnibin\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-hostroot\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-systemd\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-tmp-dir\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-d\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-conf-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-kubelet-config\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-conf-dir\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847542    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-os-release\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847598    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-kubelet-config\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.849386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-os-release\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-cni-binary-copy\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847707    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-script-lib\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-k8s-cni-cncf-io\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-netns\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-conf\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847794    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-socket-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-k8s-cni-cncf-io\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzv5\" (UniqueName: \"kubernetes.io/projected/61575938-a2c4-4105-a8ad-21bde52da39e-kube-api-access-7tzv5\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-slash\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-systemd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-log-socket\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-netns\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.849971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.847942    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-etc-sysctl-conf\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848029    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-slash\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848050    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz498\" (UniqueName: \"kubernetes.io/projected/093223d9-cfe3-44b7-adae-0046482639a6-kube-api-access-kz498\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-kubelet\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-log-socket\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-socket-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-var-lib-kubelet\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-multus-certs\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848055    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-run-systemd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848235    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-host-run-multus-certs\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.848259    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:32.850431 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.848316    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:33.348299047 +0000 UTC m=+3.106898871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmhn\" (UniqueName: \"kubernetes.io/projected/121406d1-00ed-49e7-8a20-34bc4f265c1d-kube-api-access-9hmhn\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-etc-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-netd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-config\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848441    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-cni-netd\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-etc-openvswitch\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50619687-a54b-4fcb-a9b1-d415546bf4e4-cni-binary-copy\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848461    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-env-overrides\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-node-log\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093223d9-cfe3-44b7-adae-0046482639a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-node-log\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-socket-dir-parent\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-kubelet\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.850845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb269960-6a56-4e98-8f0b-1ef412a69917-ovn-node-metrics-cert\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-multus-socket-dir-parent\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-lib-modules\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb269960-6a56-4e98-8f0b-1ef412a69917-host-kubelet\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-tmp\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-dbus\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848942    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-ovnkube-config\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-etc-kubernetes\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.848981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-etc-kubernetes\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbnh\" (UniqueName: \"kubernetes.io/projected/50619687-a54b-4fcb-a9b1-d415546bf4e4-kube-api-access-kcbnh\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb269960-6a56-4e98-8f0b-1ef412a69917-env-overrides\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-device-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-lib-modules\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.851423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-hosts-file\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849167    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-dbus\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/121406d1-00ed-49e7-8a20-34bc4f265c1d-host\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849185    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-device-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/121406d1-00ed-49e7-8a20-34bc4f265c1d-host\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-hosts-file\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-run\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-cnibin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-sys-fs\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-sys-fs\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849441    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/022617a2-2d06-422f-aaf0-012975df1739-run\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849434    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61575938-a2c4-4105-a8ad-21bde52da39e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50619687-a54b-4fcb-a9b1-d415546bf4e4-cnibin\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.849792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/093223d9-cfe3-44b7-adae-0046482639a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.852173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.850432    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-etc-tuned\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.852728 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.850818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ffae37-af09-4fc7-bbe5-290183f73844-agent-certs\") pod \"konnectivity-agent-qftlq\" (UID: \"d2ffae37-af09-4fc7-bbe5-290183f73844\") " pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:32.852728 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.851499    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb269960-6a56-4e98-8f0b-1ef412a69917-ovn-node-metrics-cert\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.852728 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.852082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022617a2-2d06-422f-aaf0-012975df1739-tmp\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.855333 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.855312    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:32.855333 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.855330    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:32.855534 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.855340    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:32.855534 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:32.855384    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:05:33.355373061 +0000 UTC m=+3.113972873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:32.858272 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.858242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzv5\" (UniqueName: \"kubernetes.io/projected/61575938-a2c4-4105-a8ad-21bde52da39e-kube-api-access-7tzv5\") pod \"aws-ebs-csi-driver-node-stth8\" (UID: \"61575938-a2c4-4105-a8ad-21bde52da39e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:32.858400 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.858378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dsk\" (UniqueName: \"kubernetes.io/projected/a49cd7a0-4e03-4c00-96aa-3b2d491389b1-kube-api-access-v5dsk\") pod \"node-resolver-tfr4b\" (UID: \"a49cd7a0-4e03-4c00-96aa-3b2d491389b1\") " pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:32.858823 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.858787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr6n2\" (UniqueName: \"kubernetes.io/projected/cb269960-6a56-4e98-8f0b-1ef412a69917-kube-api-access-rr6n2\") pod \"ovnkube-node-tgk76\" (UID: \"cb269960-6a56-4e98-8f0b-1ef412a69917\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:32.858823 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.858818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgwt\" (UniqueName: \"kubernetes.io/projected/022617a2-2d06-422f-aaf0-012975df1739-kube-api-access-sfgwt\") pod \"tuned-qhm6c\" (UID: \"022617a2-2d06-422f-aaf0-012975df1739\") " pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:32.859000 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.858973    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz498\" (UniqueName: \"kubernetes.io/projected/093223d9-cfe3-44b7-adae-0046482639a6-kube-api-access-kz498\") pod \"multus-additional-cni-plugins-fr9qd\" (UID: \"093223d9-cfe3-44b7-adae-0046482639a6\") " pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:32.859063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.859012    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rfx9\" (UniqueName: \"kubernetes.io/projected/09b996f5-2d30-4a67-b349-c56296d7b297-kube-api-access-9rfx9\") pod \"iptables-alerter-hq8nk\" (UID: \"09b996f5-2d30-4a67-b349-c56296d7b297\") " pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:32.860881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.859611    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmhn\" (UniqueName: \"kubernetes.io/projected/121406d1-00ed-49e7-8a20-34bc4f265c1d-kube-api-access-9hmhn\") pod \"node-ca-xkvxj\" (UID: \"121406d1-00ed-49e7-8a20-34bc4f265c1d\") " pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:32.860881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.860453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbnh\" (UniqueName: \"kubernetes.io/projected/50619687-a54b-4fcb-a9b1-d415546bf4e4-kube-api-access-kcbnh\") pod \"multus-tdzgt\" (UID: \"50619687-a54b-4fcb-a9b1-d415546bf4e4\") " pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:32.862158 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.862136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6hc\" (UniqueName: \"kubernetes.io/projected/7a08b963-67ee-4331-9f33-939660d0e2e6-kube-api-access-hw6hc\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:32.895934 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.895870    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"3f4eaa5d8f91e8f1be5b963701a60942","Type":"ContainerStarted","Data":"ddff6c711205ce34b8e418662e104d594de8f8897cf23029170d2d8b684701e0"}
Jul 13 17:05:32.897277 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:32.897251    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"6264b20985fd4899343a3d66e56bac9d","Type":"ContainerStarted","Data":"34ed21e8f4e65dfcd09b91f2de5d7a74566419502cfcfe9fe929194b92f818a5"}
Jul 13 17:05:33.015919 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.015827    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:33.024151 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.024123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hq8nk"
Jul 13 17:05:33.031189 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.031135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:05:33.034158 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.034121    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b996f5_2d30_4a67_b349_c56296d7b297.slice/crio-e223f5302ea26b1436eca34a69689243b0487c695d100b77c16d5d0dec8e03e4 WatchSource:0}: Error finding container e223f5302ea26b1436eca34a69689243b0487c695d100b77c16d5d0dec8e03e4: Status 404 returned error can't find the container with id e223f5302ea26b1436eca34a69689243b0487c695d100b77c16d5d0dec8e03e4
Jul 13 17:05:33.035748 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.035546    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhm6c"
Jul 13 17:05:33.042817 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.042791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fr9qd"
Jul 13 17:05:33.046437 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.046408    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb269960_6a56_4e98_8f0b_1ef412a69917.slice/crio-ffa24efb817a2585077f438dbb70a5205432731f153882ebb83941f5edac3785 WatchSource:0}: Error finding container ffa24efb817a2585077f438dbb70a5205432731f153882ebb83941f5edac3785: Status 404 returned error can't find the container with id ffa24efb817a2585077f438dbb70a5205432731f153882ebb83941f5edac3785
Jul 13 17:05:33.048457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.048436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tdzgt"
Jul 13 17:05:33.054554 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.054467    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022617a2_2d06_422f_aaf0_012975df1739.slice/crio-843b3e89f97814adf9f961a16d81cf84df6a7ae7f2782091510801578015096d WatchSource:0}: Error finding container 843b3e89f97814adf9f961a16d81cf84df6a7ae7f2782091510801578015096d: Status 404 returned error can't find the container with id 843b3e89f97814adf9f961a16d81cf84df6a7ae7f2782091510801578015096d
Jul 13 17:05:33.054701 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.054561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfr4b"
Jul 13 17:05:33.056358 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.056322    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093223d9_cfe3_44b7_adae_0046482639a6.slice/crio-145b1b6768790b641b736b6c4c175a6425b2f2a700b551f5f501111ac4bae27f WatchSource:0}: Error finding container 145b1b6768790b641b736b6c4c175a6425b2f2a700b551f5f501111ac4bae27f: Status 404 returned error can't find the container with id 145b1b6768790b641b736b6c4c175a6425b2f2a700b551f5f501111ac4bae27f
Jul 13 17:05:33.060388 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.060349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50619687_a54b_4fcb_a9b1_d415546bf4e4.slice/crio-257853337d44160dd2eaa8de5dde3737d0818544eee40e5957426285387ac022 WatchSource:0}: Error finding container 257853337d44160dd2eaa8de5dde3737d0818544eee40e5957426285387ac022: Status 404 returned error can't find the container with id 257853337d44160dd2eaa8de5dde3737d0818544eee40e5957426285387ac022
Jul 13 17:05:33.060765 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.060743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkvxj"
Jul 13 17:05:33.066035 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.065998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8"
Jul 13 17:05:33.068723 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.068474    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49cd7a0_4e03_4c00_96aa_3b2d491389b1.slice/crio-952348f636ba6565c452f209f56edf43d11990a9d1d77d5d9bb311139cb43947 WatchSource:0}: Error finding container 952348f636ba6565c452f209f56edf43d11990a9d1d77d5d9bb311139cb43947: Status 404 returned error can't find the container with id 952348f636ba6565c452f209f56edf43d11990a9d1d77d5d9bb311139cb43947
Jul 13 17:05:33.075659 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:05:33.075624    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121406d1_00ed_49e7_8a20_34bc4f265c1d.slice/crio-a792a632de01dd3e12cdeb768b1f4d49dae9954a66d49afd1e4ebc81c98cd25d WatchSource:0}: Error finding container a792a632de01dd3e12cdeb768b1f4d49dae9954a66d49afd1e4ebc81c98cd25d: Status 404 returned error can't find the container with id a792a632de01dd3e12cdeb768b1f4d49dae9954a66d49afd1e4ebc81c98cd25d
Jul 13 17:05:33.354940 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.354845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:33.355125 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.354957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:33.355125 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.355093    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:33.355278 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.355121    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:33.355278 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.355177    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:34.355157149 +0000 UTC m=+4.113756980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:33.355278 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.355202    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:34.355190887 +0000 UTC m=+4.113790699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:33.455592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.455555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:33.455784 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.455750    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:33.455784 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.455777    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:33.455923 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.455792    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:33.455923 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.455859    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:05:34.455840877 +0000 UTC m=+4.214440694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:33.761566 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.761512    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:00:33 +0000 UTC" deadline="2027-12-20 04:44:40.721529639 +0000 UTC"
Jul 13 17:05:33.761566 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.761556    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12587h39m6.959978316s"
Jul 13 17:05:33.889307 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.889259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:33.889468 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:33.889407    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:33.901824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.901780    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkvxj" event={"ID":"121406d1-00ed-49e7-8a20-34bc4f265c1d","Type":"ContainerStarted","Data":"a792a632de01dd3e12cdeb768b1f4d49dae9954a66d49afd1e4ebc81c98cd25d"}
Jul 13 17:05:33.904818 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.904782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfr4b" event={"ID":"a49cd7a0-4e03-4c00-96aa-3b2d491389b1","Type":"ContainerStarted","Data":"952348f636ba6565c452f209f56edf43d11990a9d1d77d5d9bb311139cb43947"}
Jul 13 17:05:33.906537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.906487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerStarted","Data":"145b1b6768790b641b736b6c4c175a6425b2f2a700b551f5f501111ac4bae27f"}
Jul 13 17:05:33.908053 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.907995    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hq8nk" event={"ID":"09b996f5-2d30-4a67-b349-c56296d7b297","Type":"ContainerStarted","Data":"e223f5302ea26b1436eca34a69689243b0487c695d100b77c16d5d0dec8e03e4"}
Jul 13 17:05:33.911749 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.911700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qftlq" event={"ID":"d2ffae37-af09-4fc7-bbe5-290183f73844","Type":"ContainerStarted","Data":"84ba8d34c5cf8ab2891d449462b95f2089fcb2210cd62107190c00b1a6917fa7"}
Jul 13 17:05:33.913203 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.913173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tdzgt" event={"ID":"50619687-a54b-4fcb-a9b1-d415546bf4e4","Type":"ContainerStarted","Data":"257853337d44160dd2eaa8de5dde3737d0818544eee40e5957426285387ac022"}
Jul 13 17:05:33.914893 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.914840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhm6c" event={"ID":"022617a2-2d06-422f-aaf0-012975df1739","Type":"ContainerStarted","Data":"843b3e89f97814adf9f961a16d81cf84df6a7ae7f2782091510801578015096d"}
Jul 13 17:05:33.916990 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.916964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"ffa24efb817a2585077f438dbb70a5205432731f153882ebb83941f5edac3785"}
Jul 13 17:05:33.920224 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:33.920198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8" event={"ID":"61575938-a2c4-4105-a8ad-21bde52da39e","Type":"ContainerStarted","Data":"076953f4513b1944be570e2aa6cff6b9c9c766a828b20b55c5518a7e89ee9890"}
Jul 13 17:05:34.364458 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.364375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:34.364748 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.364480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:34.364748 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.364612    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:34.364748 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.364679    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:36.364659609 +0000 UTC m=+6.123259426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:34.365194 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.365173    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:34.365320 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.365242    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:36.365223336 +0000 UTC m=+6.123823150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:34.465864 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.465182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:34.465864 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.465400    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:34.465864 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.465425    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:34.465864 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.465438    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:34.465864 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.465503    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:05:36.465481444 +0000 UTC m=+6.224081282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:34.762289 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.762216    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:00:33 +0000 UTC" deadline="2028-04-11 10:35:34.101198336 +0000 UTC"
Jul 13 17:05:34.762289 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.762283    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15305h29m59.338919501s"
Jul 13 17:05:34.891323 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.891283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:34.891509 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.891439    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:34.891926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:34.891889    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:34.892117 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:34.892009    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:35.889026 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:35.888989    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:35.889594 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:35.889160    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:36.382905 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:36.382864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:36.383163 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:36.382935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:36.383163 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.383115    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:36.383320 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.383187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:40.383165825 +0000 UTC m=+10.141765638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:36.383674 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.383619    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:36.383848 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.383681    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:40.383664305 +0000 UTC m=+10.142264121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:36.483787 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:36.483741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:36.483969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.483916    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:36.483969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.483937    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:36.483969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.483949    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:36.484179 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.484022    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:05:40.483991003 +0000 UTC m=+10.242590833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:36.889894 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:36.889849    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:36.890400 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.890013    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:36.890659 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:36.890510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:36.890659 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:36.890622    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:37.889093 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:37.888990    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:37.889282 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:37.889211    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:38.890219 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:38.890138    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:38.890710 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:38.890285    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:38.891723 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:38.891698    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:38.891821 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:38.891804    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:39.889411 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:39.889372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:39.889606 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:39.889510    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:40.416935 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:40.416898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:40.417296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:40.416964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:40.417296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.417104    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:40.417296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.417168    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:48.41714827 +0000 UTC m=+18.175748085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:40.417296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.417230    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:40.417296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.417253    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:05:48.417246105 +0000 UTC m=+18.175845914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:40.517743 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:40.517692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:40.517977 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.517956    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:40.518138 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.517985    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:40.518138 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.517997    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:40.518138 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.518072    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:05:48.518054758 +0000 UTC m=+18.276654573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:40.890820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:40.890340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:40.890820 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.890474    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:40.890820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:40.890672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:40.890820 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:40.890779    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:41.889716 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:41.889165    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:41.889716 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:41.889303    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:42.893337 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:42.893247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:42.893816 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:42.893372    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:42.893816 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:42.893684    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:42.893816 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:42.893764    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:43.889480 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:43.889443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:43.889592 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:43.889558    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:44.889678 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:44.889637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:44.890148 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:44.889692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:44.890148 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:44.889793    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:44.890148 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:44.889891    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:45.889778 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:45.889740    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:45.890237 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:45.889868    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:46.889457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:46.889420    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:46.889643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:46.889431    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:46.889643 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:46.889546    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:46.889769 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:46.889651    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:47.889075 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:47.889045    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:47.889447 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:47.889149    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:48.476029 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:48.475979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:48.476201 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:48.476065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:48.476201 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.476133    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:48.476201 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.476174    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:48.476337 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.476211    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:04.476187485 +0000 UTC m=+34.234787295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:05:48.476337 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.476231    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:04.476221309 +0000 UTC m=+34.234821126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:05:48.576787 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:48.576743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:48.576969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.576889    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:05:48.576969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.576908    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:05:48.576969 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.576920    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:48.577149 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.576979    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:06:04.576961481 +0000 UTC m=+34.335561292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:05:48.889042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:48.888946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:48.889197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:48.888946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:48.889197 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.889102    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:48.889197 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:48.889168    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:49.889430 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:49.889386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:49.889871 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:49.889519    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:50.889662 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:50.889628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:50.889662 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:50.889651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:50.890167 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:50.889757    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:50.890167 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:50.889882    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:51.889542 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:51.889500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:51.889707 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:51.889619    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:52.889426 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.889185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:52.889576 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:52.889547    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:52.889776 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.889195    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:52.890653 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:52.890598    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:52.965777 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.965739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"3f4eaa5d8f91e8f1be5b963701a60942","Type":"ContainerStarted","Data":"f41476aa006a6c448b5e19ba024d341e66e558435d27738b7b4efb6a41c1a66a"}
Jul 13 17:05:52.968769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.968732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tdzgt" event={"ID":"50619687-a54b-4fcb-a9b1-d415546bf4e4","Type":"ContainerStarted","Data":"7aa376a65097ad100c6ce8c2f3f4eb0bcc77f0785057e9ea34111bb3d1f3ae8e"}
Jul 13 17:05:52.970942 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.970916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhm6c" event={"ID":"022617a2-2d06-422f-aaf0-012975df1739","Type":"ContainerStarted","Data":"bff56d564a50ac313f86dcfeea9bf1e981b137fb1b7af2178dabd9942bd7d80f"}
Jul 13 17:05:52.973063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.973007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"0e7998b0c19fb41237a2cd169e3f749d994b7300d52c6ef9618e8da9238b5783"}
Jul 13 17:05:52.980329 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.980282    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" podStartSLOduration=20.98026928 podStartE2EDuration="20.98026928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:52.979778413 +0000 UTC m=+22.738378246" watchObservedRunningTime="2026-07-13 17:05:52.98026928 +0000 UTC m=+22.738869111"
Jul 13 17:05:52.997352 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:52.997288    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qhm6c" podStartSLOduration=2.5415702319999998 podStartE2EDuration="21.997265446s" totalImagesPullingTime="19.455695214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:52.996527399 +0000 UTC m=+22.755127231" watchObservedRunningTime="2026-07-13 17:05:52.997265446 +0000 UTC m=+22.755865278"
Jul 13 17:05:53.013301 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.013253    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tdzgt" podStartSLOduration=2.546464323 podStartE2EDuration="22.013238001s" totalImagesPullingTime="19.466773678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:53.012454219 +0000 UTC m=+22.771054041" watchObservedRunningTime="2026-07-13 17:05:53.013238001 +0000 UTC m=+22.771837823"
Jul 13 17:05:53.889766 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.889584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:53.890353 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:53.889840    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:53.977860 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.977832    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:05:53.978161 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978138    2567 generic.go:356] "Generic (PLEG): container finished" podID="cb269960-6a56-4e98-8f0b-1ef412a69917" containerID="8af5dbb389ee29031a49b5ab0c7b7e459ff0e8300a2c4aaba940f0b7afcff7eb" exitCode=1
Jul 13 17:05:53.978231 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"10b41b09754ec95e4157da781bed602a405215ed58ddfb626a1141cfd71b9261"}
Jul 13 17:05:53.978288 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"3e2eeeffda58df824c71884bba952be8c681db01bfdd2f345285cd71d5b47260"}
Jul 13 17:05:53.978343 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"4ab7b600a4bbf95544cc88524b175bd701c022ac35622f4cafbb8c806fdd49c7"}
Jul 13 17:05:53.978395 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"526d2ee2691b2eaf7018d02be462de85d4d3c90fbff5de50014a04b6d8b68c46"}
Jul 13 17:05:53.978395 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.978376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerDied","Data":"8af5dbb389ee29031a49b5ab0c7b7e459ff0e8300a2c4aaba940f0b7afcff7eb"}
Jul 13 17:05:53.979461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.979434    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8" event={"ID":"61575938-a2c4-4105-a8ad-21bde52da39e","Type":"ContainerStarted","Data":"27b6cca0828cd0fb2ff824fa8ed99002a2df705be8a52c675cd3b14ef1660c8f"}
Jul 13 17:05:53.980710 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.980689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkvxj" event={"ID":"121406d1-00ed-49e7-8a20-34bc4f265c1d","Type":"ContainerStarted","Data":"f114f0eabf588994fb099c2f06622255ebfaa7b57ad58e0a2c00f56cf8c74469"}
Jul 13 17:05:53.982049 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.982008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfr4b" event={"ID":"a49cd7a0-4e03-4c00-96aa-3b2d491389b1","Type":"ContainerStarted","Data":"8d67d8673180f775124abcacb3fc486aaa154b43ba60450e36afa69602a4d730"}
Jul 13 17:05:53.983409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.983389    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="852bd493e524503f948206cf522f76e861366666252aceb59a2d567396004090" exitCode=0
Jul 13 17:05:53.983501 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.983429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"852bd493e524503f948206cf522f76e861366666252aceb59a2d567396004090"}
Jul 13 17:05:53.984933 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.984895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hq8nk" event={"ID":"09b996f5-2d30-4a67-b349-c56296d7b297","Type":"ContainerStarted","Data":"f7afa33612c07e2e0bc34c0409b8481c49159650fa39e8a19394a686b3463e60"}
Jul 13 17:05:53.986319 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.986302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qftlq" event={"ID":"d2ffae37-af09-4fc7-bbe5-290183f73844","Type":"ContainerStarted","Data":"250d0eab4a93deaeb72218ce6b58409d09845d9e58fe44cd2d944ff0ce4cac1b"}
Jul 13 17:05:53.987546 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.987527    2567 generic.go:356] "Generic (PLEG): container finished" podID="6264b20985fd4899343a3d66e56bac9d" containerID="8b9fba96a69243a4d6b56825b28bce357faaa7370ae999a674e5f97bc08b245a" exitCode=0
Jul 13 17:05:53.987638 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.987552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"6264b20985fd4899343a3d66e56bac9d","Type":"ContainerDied","Data":"8b9fba96a69243a4d6b56825b28bce357faaa7370ae999a674e5f97bc08b245a"}
Jul 13 17:05:53.995196 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:53.995162    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xkvxj" podStartSLOduration=3.558275635 podStartE2EDuration="22.995150784s" totalImagesPullingTime="19.436875149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:53.994964706 +0000 UTC m=+23.753564534" watchObservedRunningTime="2026-07-13 17:05:53.995150784 +0000 UTC m=+23.753750615"
Jul 13 17:05:54.024769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.024713    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qftlq" podStartSLOduration=3.538186816 podStartE2EDuration="23.024695683s" totalImagesPullingTime="19.486508867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:54.024270636 +0000 UTC m=+23.782870468" watchObservedRunningTime="2026-07-13 17:05:54.024695683 +0000 UTC m=+23.783295516"
Jul 13 17:05:54.041472 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.041395    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hq8nk" podStartSLOduration=12.838699511 podStartE2EDuration="23.041378202s" totalImagesPullingTime="10.202678691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:54.041278975 +0000 UTC m=+23.799878806" watchObservedRunningTime="2026-07-13 17:05:54.041378202 +0000 UTC m=+23.799978034"
Jul 13 17:05:54.074752 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.074708    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tfr4b" podStartSLOduration=3.634157593 podStartE2EDuration="23.074696959s" totalImagesPullingTime="19.440539366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:54.074098466 +0000 UTC m=+23.832698298" watchObservedRunningTime="2026-07-13 17:05:54.074696959 +0000 UTC m=+23.833296790"
Jul 13 17:05:54.849289 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.849263    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 17:05:54.892848 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.892813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:54.893301 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.892813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:54.893301 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:54.892921    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:54.893301 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:54.892992    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:54.991846 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.991532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8" event={"ID":"61575938-a2c4-4105-a8ad-21bde52da39e","Type":"ContainerStarted","Data":"c194999e9078543f91e42c3ac43240de1938a9e9e396840d1d4d779323385961"}
Jul 13 17:05:54.993633 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:54.993591    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"6264b20985fd4899343a3d66e56bac9d","Type":"ContainerStarted","Data":"f1a13f4f57fd6dc19b9ceae797b222c5717e78ce9bf5aa10caa6ea93aadd00b7"}
Jul 13 17:05:55.008485 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.008436    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" podStartSLOduration=23.008402133 podStartE2EDuration="23.008402133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:55.008279276 +0000 UTC m=+24.766879110" watchObservedRunningTime="2026-07-13 17:05:55.008402133 +0000 UTC m=+24.767001967"
Jul 13 17:05:55.725939 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.725901    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfr4b_a49cd7a0-4e03-4c00-96aa-3b2d491389b1/dns-node-resolver/0.log"
Jul 13 17:05:55.815668 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.815525    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:05:54.849285102Z","UUID":"43d44fce-e941-4ced-b6e0-938006cc494a","Handler":null,"Name":"","Endpoint":""}
Jul 13 17:05:55.817241 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.817216    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 17:05:55.817353 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.817264    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 17:05:55.888767 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:55.888730    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:55.888909 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:55.888865    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:56.000593 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.000570    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:05:56.001092 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.001044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"6a8169b37db523d19cab2f8743c70538b5663f534425d3ef3ac89f90538d1a02"}
Jul 13 17:05:56.003804 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.003773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8" event={"ID":"61575938-a2c4-4105-a8ad-21bde52da39e","Type":"ContainerStarted","Data":"73e22e8e76fbb9dd16fcaf555908ef5caf1aa60688358058ddd0aaba461c669e"}
Jul 13 17:05:56.660427 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.660391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:56.661176 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.661140    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:56.677842 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.677795    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stth8" podStartSLOduration=3.594593657 podStartE2EDuration="25.677778651s" totalImagesPullingTime="22.083184994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:56.022741323 +0000 UTC m=+25.781341155" watchObservedRunningTime="2026-07-13 17:05:56.677778651 +0000 UTC m=+26.436378504"
Jul 13 17:05:56.705639 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.705612    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkvxj_121406d1-00ed-49e7-8a20-34bc4f265c1d/node-ca/0.log"
Jul 13 17:05:56.895331 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.895303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:56.895491 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:56.895423    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:56.895491 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:56.895474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:56.895613 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:56.895589    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:57.006306 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:57.006272    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:57.007027 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:57.006634    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qftlq"
Jul 13 17:05:57.889344 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:57.889314    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:57.889532 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:57.889477    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:05:58.889181 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:58.888946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:05:58.889680 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:58.889001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:05:58.889680 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:58.889296    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:05:58.889680 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:58.889346    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:05:59.012665 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.012587    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="1ac72d5452b62fd74a373c7e8c8fbacaa9950779687a71547036e5aea2ca7eef" exitCode=0
Jul 13 17:05:59.012826 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.012675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"1ac72d5452b62fd74a373c7e8c8fbacaa9950779687a71547036e5aea2ca7eef"}
Jul 13 17:05:59.016419 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.016400    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:05:59.016809 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.016788    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"8551f32f67b8596fd955fd6f37fc2bf321d285bd4399725f9a7ecccf27dde4d4"}
Jul 13 17:05:59.017168 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.017152    2567 scope.go:117] "RemoveContainer" containerID="8af5dbb389ee29031a49b5ab0c7b7e459ff0e8300a2c4aaba940f0b7afcff7eb"
Jul 13 17:05:59.889316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:05:59.889279    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:05:59.889757 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:05:59.889379    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:00.021801 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.021777    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:06:00.022146 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.022121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" event={"ID":"cb269960-6a56-4e98-8f0b-1ef412a69917","Type":"ContainerStarted","Data":"3686e16e8789ff67e36538215e4ff73fbdf6d4f1a8e35cbc4116d0df159cf0cd"}
Jul 13 17:06:00.022303 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.022290    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:00.022341 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.022336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:00.022464 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.022449    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:00.037816 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.037788    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:00.037965 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.037901    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:00.055687 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.055636    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76" podStartSLOduration=9.33211241 podStartE2EDuration="29.055617055s" totalImagesPullingTime="19.723504645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:00.055570653 +0000 UTC m=+29.814170486" watchObservedRunningTime="2026-07-13 17:06:00.055617055 +0000 UTC m=+29.814216886"
Jul 13 17:06:00.891056 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.890800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:00.891417 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:00.890850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:00.891417 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:00.891161    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:00.891417 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:00.891192    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:01.026601 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:01.026569    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="78be0c17564101f934db760b0440ad11228a9f83379d8c160d411eb056ff84eb" exitCode=0
Jul 13 17:06:01.026745 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:01.026649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"78be0c17564101f934db760b0440ad11228a9f83379d8c160d411eb056ff84eb"}
Jul 13 17:06:01.889214 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:01.889178    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:01.889393 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:01.889278    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:02.888836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:02.888799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:02.889296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:02.888939    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:02.889296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:02.888983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:02.889296 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:02.889080    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:03.032711 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:03.032680    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="39a726f8821d04d9d675645355f6971a08b4233323a77d43a93afbef78510579" exitCode=0
Jul 13 17:06:03.032884 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:03.032744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"39a726f8821d04d9d675645355f6971a08b4233323a77d43a93afbef78510579"}
Jul 13 17:06:03.889233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:03.889186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:03.889637 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:03.889338    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:04.498361 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:04.498319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:04.498598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:04.498396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:04.498598 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.498486    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:06:04.498598 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.498506    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:06:04.498598 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.498567    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret podName:80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:36.49854616 +0000 UTC m=+66.257145973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret") pod "global-pull-secret-syncer-tplfd" (UID: "80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:06:04.498598 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.498586    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs podName:7a08b963-67ee-4331-9f33-939660d0e2e6 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:36.498577071 +0000 UTC m=+66.257176886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs") pod "network-metrics-daemon-48lrl" (UID: "7a08b963-67ee-4331-9f33-939660d0e2e6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:06:04.599065 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:04.599027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:04.599220 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.599174    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:06:04.599220 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.599199    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:06:04.599220 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.599212    2567 projected.go:196] Error preparing data for projected volume kube-api-access-nsrjf for pod openshift-network-diagnostics/network-check-target-pjng8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:06:04.599361 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.599276    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf podName:81368231-f10a-4f2d-9312-27b5170044aa nodeName:}" failed. No retries permitted until 2026-07-13 17:06:36.599260838 +0000 UTC m=+66.357860647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsrjf" (UniqueName: "kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf") pod "network-check-target-pjng8" (UID: "81368231-f10a-4f2d-9312-27b5170044aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:06:04.888994 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:04.888916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:04.889157 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:04.888917    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:04.889157 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.889076    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:04.889157 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:04.889140    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:05.889544 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:05.889509    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:05.890030 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:05.889621    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:06.889634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:06.889602    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:06.890059 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:06.889720    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:06.890059 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:06.889780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:06.890059 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:06.889890    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:07.043889 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:07.043852    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerStarted","Data":"f8bdd1592d349f48d5fe77bd1cb3f4c16ee70e907e0e348e130787ef629be274"}
Jul 13 17:06:07.888851 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:07.888824    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:07.889009 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:07.888915    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:08.048298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:08.048262    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="f8bdd1592d349f48d5fe77bd1cb3f4c16ee70e907e0e348e130787ef629be274" exitCode=0
Jul 13 17:06:08.048298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:08.048301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"f8bdd1592d349f48d5fe77bd1cb3f4c16ee70e907e0e348e130787ef629be274"}
Jul 13 17:06:08.889498 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:08.889457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:08.889691 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:08.889607    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:08.889691 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:08.889650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:08.889821 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:08.889740    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:09.053777 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:09.053748    2567 generic.go:356] "Generic (PLEG): container finished" podID="093223d9-cfe3-44b7-adae-0046482639a6" containerID="f9163439b971fdfedfedd9cc3d186cdad1c9aecb5c652d2a5758ca8f1fa569b3" exitCode=0
Jul 13 17:06:09.054150 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:09.053790    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerDied","Data":"f9163439b971fdfedfedd9cc3d186cdad1c9aecb5c652d2a5758ca8f1fa569b3"}
Jul 13 17:06:09.889386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:09.889352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:09.889576 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:09.889474    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:10.059244 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:10.059210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" event={"ID":"093223d9-cfe3-44b7-adae-0046482639a6","Type":"ContainerStarted","Data":"eb54a06d07e43abbabf043cf2b5db99e7284ed89fdcb2efe2fc3af0f52c3fbaf"}
Jul 13 17:06:10.080260 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:10.080216    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fr9qd" podStartSLOduration=8.829542447 podStartE2EDuration="39.080200641s" totalImagesPullingTime="30.250658194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:10.079864803 +0000 UTC m=+39.838464634" watchObservedRunningTime="2026-07-13 17:06:10.080200641 +0000 UTC m=+39.838800472"
Jul 13 17:06:10.890156 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:10.890120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:10.890325 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:10.890235    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:10.890325 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:10.890292    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:10.890407 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:10.890379    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:11.889338 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:11.889298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:11.889759 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:11.889434    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:12.889151 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:12.889115    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:12.889330 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:12.889228    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:12.889330 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:12.889282    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:12.889603 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:12.889371    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:13.889031 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:13.888991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:13.889205 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:13.889109    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:14.889352 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:14.889324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:14.889352 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:14.889338    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:14.889754 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:14.889422    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:14.889754 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:14.889534    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:15.889332 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:15.889291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:15.889623 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:15.889425    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:16.888987 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:16.888959    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:16.889169 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:16.888962    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:16.889169 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:16.889089    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:16.889169 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:16.889148    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:17.889240 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:17.889209    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:17.889615 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:17.889313    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:18.889772 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:18.889738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:18.890162 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:18.889778    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:18.890162 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:18.889859    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:18.890162 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:18.889975    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:19.554377 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.554118    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tplfd"]
Jul 13 17:06:19.554547 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.554509    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:19.554645 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:19.554622    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:19.555602 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.555577    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48lrl"]
Jul 13 17:06:19.555714 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.555692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:19.555822 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:19.555800    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:19.568104 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.568079    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjng8"]
Jul 13 17:06:19.568213 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:19.568183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:19.568280 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:19.568262    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:20.890027 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:20.889983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:20.890532 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:20.890088    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:20.890532 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:20.890172    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:20.890532 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:20.890254    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:21.889501 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:21.889469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:21.889687 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:21.889578    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:22.888948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:22.888909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:22.889411 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:22.889048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:22.889411 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:22.889162    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tplfd" podUID="80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1"
Jul 13 17:06:22.889411 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:22.889050    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48lrl" podUID="7a08b963-67ee-4331-9f33-939660d0e2e6"
Jul 13 17:06:23.888729 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:23.888685    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:23.888966 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:23.888798    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjng8" podUID="81368231-f10a-4f2d-9312-27b5170044aa"
Jul 13 17:06:24.524760 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.524728    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeReady"
Jul 13 17:06:24.524926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.524864    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 17:06:24.575510 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.575471    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-946mn"]
Jul 13 17:06:24.577474 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.577455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.579409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.579389    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 17:06:24.579409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.579396    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xtcxn\""
Jul 13 17:06:24.579573 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.579423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 17:06:24.586143 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.586120    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bmwnm"]
Jul 13 17:06:24.588069 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.588048    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-946mn"]
Jul 13 17:06:24.588174 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.588121    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.590333 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.590302    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 17:06:24.590430 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.590347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rmd8z\""
Jul 13 17:06:24.590611 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.590597    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 17:06:24.590751 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.590736    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 17:06:24.590960 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.590946    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 17:06:24.598566 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.598540    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmwnm"]
Jul 13 17:06:24.643974 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.643943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9ef09-1979-4872-94dc-916777fb56c6-data-volume\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.643974 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.643975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-tmp-dir\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.644183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.643993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cab9ef09-1979-4872-94dc-916777fb56c6-crio-socket\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.644183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cab9ef09-1979-4872-94dc-916777fb56c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.644183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-metrics-tls\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.644183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngc6k\" (UniqueName: \"kubernetes.io/projected/cab9ef09-1979-4872-94dc-916777fb56c6-kube-api-access-ngc6k\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.644183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cab9ef09-1979-4872-94dc-916777fb56c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.644329 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-config-volume\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.644329 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.644263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6drc\" (UniqueName: \"kubernetes.io/projected/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-kube-api-access-n6drc\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.675774 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.675747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t59nw"]
Jul 13 17:06:24.677525 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.677510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.679594 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.679574    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghws2\""
Jul 13 17:06:24.679702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.679627    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 17:06:24.679702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.679581    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 17:06:24.679702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.679583    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 17:06:24.693707 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.693686    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t59nw"]
Jul 13 17:06:24.745401 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9ef09-1979-4872-94dc-916777fb56c6-data-volume\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745401 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-tmp-dir\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.745598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cab9ef09-1979-4872-94dc-916777fb56c6-crio-socket\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cab9ef09-1979-4872-94dc-916777fb56c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-metrics-tls\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.745708 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cab9ef09-1979-4872-94dc-916777fb56c6-crio-socket\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745748 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngc6k\" (UniqueName: \"kubernetes.io/projected/cab9ef09-1979-4872-94dc-916777fb56c6-kube-api-access-ngc6k\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cab9ef09-1979-4872-94dc-916777fb56c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9ef09-1979-4872-94dc-916777fb56c6-data-volume\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.745875 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-config-volume\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.745875 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-tmp-dir\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.745978 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6drc\" (UniqueName: \"kubernetes.io/projected/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-kube-api-access-n6drc\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.745978 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32017910-651c-485f-b4e1-ca6f603185ed-cert\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.745978 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.745959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2ft\" (UniqueName: \"kubernetes.io/projected/32017910-651c-485f-b4e1-ca6f603185ed-kube-api-access-5l2ft\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.746336 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.746311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cab9ef09-1979-4872-94dc-916777fb56c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.746336 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.746332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-config-volume\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.749572 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.749552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cab9ef09-1979-4872-94dc-916777fb56c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.749681 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.749661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-metrics-tls\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.753615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.753591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngc6k\" (UniqueName: \"kubernetes.io/projected/cab9ef09-1979-4872-94dc-916777fb56c6-kube-api-access-ngc6k\") pod \"insights-runtime-extractor-bmwnm\" (UID: \"cab9ef09-1979-4872-94dc-916777fb56c6\") " pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.753972 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.753948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6drc\" (UniqueName: \"kubernetes.io/projected/8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af-kube-api-access-n6drc\") pod \"dns-default-946mn\" (UID: \"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af\") " pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.846948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.846862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32017910-651c-485f-b4e1-ca6f603185ed-cert\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.846948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.846898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2ft\" (UniqueName: \"kubernetes.io/projected/32017910-651c-485f-b4e1-ca6f603185ed-kube-api-access-5l2ft\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.849265 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.849243    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32017910-651c-485f-b4e1-ca6f603185ed-cert\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.854789 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.854766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2ft\" (UniqueName: \"kubernetes.io/projected/32017910-651c-485f-b4e1-ca6f603185ed-kube-api-access-5l2ft\") pod \"ingress-canary-t59nw\" (UID: \"32017910-651c-485f-b4e1-ca6f603185ed\") " pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:24.886573 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.886537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:24.889388 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.889370    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:24.889766 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.889371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:24.894772 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.894569    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5r2pv\""
Jul 13 17:06:24.894912 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.894880    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:06:24.894969 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.894878    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:06:24.896365 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.896341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmwnm"
Jul 13 17:06:24.986408 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:24.986371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t59nw"
Jul 13 17:06:25.045254 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.044937    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-946mn"]
Jul 13 17:06:25.046716 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.046627    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmwnm"]
Jul 13 17:06:25.054973 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:25.054946    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab9ef09_1979_4872_94dc_916777fb56c6.slice/crio-04be3eabe136f2128515c730d7f78627ba1d862d3842ef66ccb00148df2d8e4c WatchSource:0}: Error finding container 04be3eabe136f2128515c730d7f78627ba1d862d3842ef66ccb00148df2d8e4c: Status 404 returned error can't find the container with id 04be3eabe136f2128515c730d7f78627ba1d862d3842ef66ccb00148df2d8e4c
Jul 13 17:06:25.093670 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.093623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmwnm" event={"ID":"cab9ef09-1979-4872-94dc-916777fb56c6","Type":"ContainerStarted","Data":"04be3eabe136f2128515c730d7f78627ba1d862d3842ef66ccb00148df2d8e4c"}
Jul 13 17:06:25.094794 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.094766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-946mn" event={"ID":"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af","Type":"ContainerStarted","Data":"80984ed49ac0455c55e8f24678f2778ae18c6370f9f4ff9d4bb2b68f98d77705"}
Jul 13 17:06:25.120462 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.120399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t59nw"]
Jul 13 17:06:25.124086 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:25.124059    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32017910_651c_485f_b4e1_ca6f603185ed.slice/crio-5d1a473a097d615b835a346218463ddd7704b5a98a40ae0864af37c239b75865 WatchSource:0}: Error finding container 5d1a473a097d615b835a346218463ddd7704b5a98a40ae0864af37c239b75865: Status 404 returned error can't find the container with id 5d1a473a097d615b835a346218463ddd7704b5a98a40ae0864af37c239b75865
Jul 13 17:06:25.889427 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.889391    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:25.891620 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.891592    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wvvhh\""
Jul 13 17:06:25.891772 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.891603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:06:25.891772 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:25.891634    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:06:26.100995 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.100920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t59nw" event={"ID":"32017910-651c-485f-b4e1-ca6f603185ed","Type":"ContainerStarted","Data":"5d1a473a097d615b835a346218463ddd7704b5a98a40ae0864af37c239b75865"}
Jul 13 17:06:26.712336 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.712307    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"]
Jul 13 17:06:26.715240 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.714520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.716493    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.716829    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.717176    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r6vw4\""
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.717505    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.717744    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 17:06:26.718249 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.717959    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 17:06:26.729433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.729410    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"]
Jul 13 17:06:26.740805 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.740747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"]
Jul 13 17:06:26.744481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.743948    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-66nmm"]
Jul 13 17:06:26.744481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.744090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.746730 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.746568    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 17:06:26.747756 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.746972    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 17:06:26.747756 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.746980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vkgrk\""
Jul 13 17:06:26.747756 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.747347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 17:06:26.750168 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.749638    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.751831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.751530    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 17:06:26.752989 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.752971    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"]
Jul 13 17:06:26.755855 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.753844    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 17:06:26.755855 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.753928    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tbg8b\""
Jul 13 17:06:26.755855 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.754064    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-textfile\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-metrics-client-ca\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl7lr\" (UniqueName: \"kubernetes.io/projected/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-kube-api-access-tl7lr\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b511752-719b-433e-bb6f-6f924a880286-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-sys\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-wtmp\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbrv\" (UniqueName: \"kubernetes.io/projected/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-api-access-jhbrv\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjhn\" (UniqueName: \"kubernetes.io/projected/6b511752-719b-433e-bb6f-6f924a880286-kube-api-access-lhjhn\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.762897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.761695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-root\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b511752-719b-433e-bb6f-6f924a880286-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.863226 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863226 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863226 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-sys\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863226 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-wtmp\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbrv\" (UniqueName: \"kubernetes.io/projected/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-api-access-jhbrv\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863294    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjhn\" (UniqueName: \"kubernetes.io/projected/6b511752-719b-433e-bb6f-6f924a880286-kube-api-access-lhjhn\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-root\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-textfile\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.863461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-metrics-client-ca\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl7lr\" (UniqueName: \"kubernetes.io/projected/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-kube-api-access-tl7lr\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.863799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b511752-719b-433e-bb6f-6f924a880286-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.864260 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-sys\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.864431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.863797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-textfile\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.864562 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.864534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-wtmp\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.864737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-root\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.865061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-metrics-client-ca\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:26.865163    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:26.865222    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls podName:59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb nodeName:}" failed. No retries permitted until 2026-07-13 17:06:27.365203694 +0000 UTC m=+57.123803504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-8ncsl" (UID: "59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb") : secret "kube-state-metrics-tls" not found
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:26.865455    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.865466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:26.865503    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls podName:a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:27.365487517 +0000 UTC m=+57.124087329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls") pod "node-exporter-66nmm" (UID: "a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5") : secret "node-exporter-tls" not found
Jul 13 17:06:26.865564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.865507    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.866073 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.865928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.866995 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.866965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.869197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.868474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.869197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.869091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b511752-719b-433e-bb6f-6f924a880286-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:26.873085 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.870843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.882589 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.882425    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbrv\" (UniqueName: \"kubernetes.io/projected/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-api-access-jhbrv\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:26.882589 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.882535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl7lr\" (UniqueName: \"kubernetes.io/projected/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-kube-api-access-tl7lr\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:26.883321 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:26.883298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjhn\" (UniqueName: \"kubernetes.io/projected/6b511752-719b-433e-bb6f-6f924a880286-kube-api-access-lhjhn\") pod \"openshift-state-metrics-84bd68b896-6wwg5\" (UID: \"6b511752-719b-433e-bb6f-6f924a880286\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:27.032622 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.032538    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"
Jul 13 17:06:27.360484 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.360299    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:06:27.362562 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.362529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.364672 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.364458    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 17:06:27.364672 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.364520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 17:06:27.364672 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.364593    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 17:06:27.365634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.365612    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 17:06:27.365785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.365767    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 17:06:27.365866 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.365814    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 17:06:27.365961 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.365945    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bfd9n\""
Jul 13 17:06:27.366064 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.365980    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 17:06:27.366957 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.366937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:27.367147 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.366968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:27.370512 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.370460    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8ncsl\" (UID: \"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:27.370886 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.370840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5-node-exporter-tls\") pod \"node-exporter-66nmm\" (UID: \"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5\") " pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:27.375146 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.375087    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:06:27.467737 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.467737 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sx28\" (UniqueName: \"kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.467737 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.467737 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.468105 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.468105 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.467885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569230 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sx28\" (UniqueName: \"kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.569406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.569414    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.570199 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.570027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.570199 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.570117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.570613 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.570567    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.572830 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.572799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.573003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.572982    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.579708 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.579658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sx28\" (UniqueName: \"kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28\") pod \"console-74dc66947c-6wpdm\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") " pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.616738 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.616654    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5"]
Jul 13 17:06:27.660674 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.660643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"
Jul 13 17:06:27.668722 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.668686    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-66nmm"
Jul 13 17:06:27.682346 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.682278    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:27.817608 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.817572    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:06:27.823537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.823512    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.825674 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825601    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 17:06:27.825674 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825646    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 17:06:27.825854 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 17:06:27.825854 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825735    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 17:06:27.825971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 17:06:27.825971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.825929    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 17:06:27.826113 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.826062    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 17:06:27.826168 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.826124    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n6m9g\""
Jul 13 17:06:27.826356 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.826339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 17:06:27.826607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.826588    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 17:06:27.837519 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.837493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:06:27.872370 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872370 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872532    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbrw\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.872764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.872725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973417 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbrw\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:27.973675    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle podName:8907c406-bd14-4024-b6b2-931dfc3cf6c2 nodeName:}" failed. No retries permitted until 2026-07-13 17:06:28.473653146 +0000 UTC m=+58.232252974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2") : configmap references non-existent config key: ca-bundle.crt
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.973836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.974116 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.974116 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.973873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.975401 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.975034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.975745 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.975588    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.976625 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.976581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.977612 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.977161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.977612 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.977275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.977612 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.977395    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.977612 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.977558    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.978472 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.978448    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.978472 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.978467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.978662 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.978642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.978877 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.978861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:27.994082 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:27.994060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbrw\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:28.479024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.478984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:28.479974 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.479954    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:28.735226 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.735147    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:06:28.844149 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.844119    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"]
Jul 13 17:06:28.848176 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.848154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.860988 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.860962    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4sbg7\""
Jul 13 17:06:28.861307 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.861286    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 17:06:28.861727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.861710    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 17:06:28.862252 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.862235    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 17:06:28.862347 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.862232    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 17:06:28.862347 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.862278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 17:06:28.862969 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.862946    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1qkvovkk0ndpd\""
Jul 13 17:06:28.883692 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883692 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883692 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-grpc-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883917    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/367a6524-936d-420f-ae2a-c5593dafe853-metrics-client-ca\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.883971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.883948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwcj\" (UniqueName: \"kubernetes.io/projected/367a6524-936d-420f-ae2a-c5593dafe853-kube-api-access-gzwcj\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.885376 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.885357    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"]
Jul 13 17:06:28.985045 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.984995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/367a6524-936d-420f-ae2a-c5593dafe853-metrics-client-ca\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwcj\" (UniqueName: \"kubernetes.io/projected/367a6524-936d-420f-ae2a-c5593dafe853-kube-api-access-gzwcj\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985515 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985515 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.985515 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.985313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-grpc-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.986279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.986252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/367a6524-936d-420f-ae2a-c5593dafe853-metrics-client-ca\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.988127 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.988085    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.988227 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.988152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.988396 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.988353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.988617 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.988591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.988759 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.988741    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-grpc-tls\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.989236 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.989212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/367a6524-936d-420f-ae2a-c5593dafe853-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:28.998888 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:28.998864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwcj\" (UniqueName: \"kubernetes.io/projected/367a6524-936d-420f-ae2a-c5593dafe853-kube-api-access-gzwcj\") pod \"thanos-querier-77d6dd6c99-b6vhm\" (UID: \"367a6524-936d-420f-ae2a-c5593dafe853\") " pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:29.158771 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:29.158725    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:29.525034 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:29.524980    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b511752_719b_433e_bb6f_6f924a880286.slice/crio-62ef3da8c4afc5909723ee61c10e0d3972f7c84a5a441f6c904034433abac630 WatchSource:0}: Error finding container 62ef3da8c4afc5909723ee61c10e0d3972f7c84a5a441f6c904034433abac630: Status 404 returned error can't find the container with id 62ef3da8c4afc5909723ee61c10e0d3972f7c84a5a441f6c904034433abac630
Jul 13 17:06:30.113350 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:30.113305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5" event={"ID":"6b511752-719b-433e-bb6f-6f924a880286","Type":"ContainerStarted","Data":"62ef3da8c4afc5909723ee61c10e0d3972f7c84a5a441f6c904034433abac630"}
Jul 13 17:06:30.618372 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:30.618339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d0d8ee_5b4f_4e7f_9c5d_179086b745c5.slice/crio-e08ec69d3abeb40dde4f18e49707f14aa0f5aa6ffaa0289740a66b319f4bcfa8 WatchSource:0}: Error finding container e08ec69d3abeb40dde4f18e49707f14aa0f5aa6ffaa0289740a66b319f4bcfa8: Status 404 returned error can't find the container with id e08ec69d3abeb40dde4f18e49707f14aa0f5aa6ffaa0289740a66b319f4bcfa8
Jul 13 17:06:30.809797 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:30.809659    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:06:30.831803 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:30.831769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:06:30.836872 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:30.836716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8ncsl"]
Jul 13 17:06:30.839928 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:30.839880    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"]
Jul 13 17:06:30.955976 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:30.955940    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8907c406_bd14_4024_b6b2_931dfc3cf6c2.slice/crio-522d7375232e68cfbb920528f0f1ac27d1c89f9f44fe46067aee8bd6d8716eea WatchSource:0}: Error finding container 522d7375232e68cfbb920528f0f1ac27d1c89f9f44fe46067aee8bd6d8716eea: Status 404 returned error can't find the container with id 522d7375232e68cfbb920528f0f1ac27d1c89f9f44fe46067aee8bd6d8716eea
Jul 13 17:06:30.957258 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:30.956956    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25707e61_cbdc_4002_bbd6_56d24dda998f.slice/crio-65d46e995e70ec2ae43aec085525aab8d586c5fd4281bfcb3347f719fc55265f WatchSource:0}: Error finding container 65d46e995e70ec2ae43aec085525aab8d586c5fd4281bfcb3347f719fc55265f: Status 404 returned error can't find the container with id 65d46e995e70ec2ae43aec085525aab8d586c5fd4281bfcb3347f719fc55265f
Jul 13 17:06:31.119533 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.119480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-946mn" event={"ID":"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af","Type":"ContainerStarted","Data":"7e2471c13e2415585c046ebb1e06da63ef55ce282b91a86294f07d11e36af7c0"}
Jul 13 17:06:31.119726 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.119546    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-946mn" event={"ID":"8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af","Type":"ContainerStarted","Data":"dbd4bae363efb1ec3f5ba62d865427a77602e060eff91f8c45809b8ee2de0fb1"}
Jul 13 17:06:31.119726 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.119686    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:31.121086 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.120977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"b97593aa0e82d4d3a34882697449552f3801ca748f2addd64848f5d21fb1569b"}
Jul 13 17:06:31.122399 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.122369    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl" event={"ID":"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb","Type":"ContainerStarted","Data":"5ba3c84ce2eb272c8a1e6b9f58814ab3a1a9fc84b77dae772c345d5a8427c649"}
Jul 13 17:06:31.123881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.123859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t59nw" event={"ID":"32017910-651c-485f-b4e1-ca6f603185ed","Type":"ContainerStarted","Data":"f4cf933625c96122eedb0edba9cf5bea01ef939b676d3f0c223d19d2b07b455f"}
Jul 13 17:06:31.126250 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.125207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"522d7375232e68cfbb920528f0f1ac27d1c89f9f44fe46067aee8bd6d8716eea"}
Jul 13 17:06:31.127374 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.127350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-66nmm" event={"ID":"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5","Type":"ContainerStarted","Data":"e08ec69d3abeb40dde4f18e49707f14aa0f5aa6ffaa0289740a66b319f4bcfa8"}
Jul 13 17:06:31.129165 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.129111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmwnm" event={"ID":"cab9ef09-1979-4872-94dc-916777fb56c6","Type":"ContainerStarted","Data":"43da0d09a859a71bd89764ce1d469eb3f62562eea1205ff7bc77faeacd3f57dc"}
Jul 13 17:06:31.130892 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.130866    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5" event={"ID":"6b511752-719b-433e-bb6f-6f924a880286","Type":"ContainerStarted","Data":"300865bca5e791ff70655574258b752a0e2a0089c4af02510df5ff9527fcb9b4"}
Jul 13 17:06:31.130992 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.130909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5" event={"ID":"6b511752-719b-433e-bb6f-6f924a880286","Type":"ContainerStarted","Data":"e2dc6857743a5a67e9d66ece0f2847e23327a4e8c8576a0f7c45f097bbeb5031"}
Jul 13 17:06:31.131906 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.131888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dc66947c-6wpdm" event={"ID":"25707e61-cbdc-4002-bbd6-56d24dda998f","Type":"ContainerStarted","Data":"65d46e995e70ec2ae43aec085525aab8d586c5fd4281bfcb3347f719fc55265f"}
Jul 13 17:06:31.145192 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.145162    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f78f94c66-r4vxd"]
Jul 13 17:06:31.145837 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.145791    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-946mn" podStartSLOduration=1.5947961720000001 podStartE2EDuration="7.145777911s" totalImagesPullingTime="5.550981739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:31.144348879 +0000 UTC m=+60.902948710" watchObservedRunningTime="2026-07-13 17:06:31.145777911 +0000 UTC m=+60.904377742"
Jul 13 17:06:31.159628 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.159575    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t59nw" podStartSLOduration=1.675676368 podStartE2EDuration="7.159559974s" totalImagesPullingTime="5.483883606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:31.158384505 +0000 UTC m=+60.916984334" watchObservedRunningTime="2026-07-13 17:06:31.159559974 +0000 UTC m=+60.918159805"
Jul 13 17:06:31.168612 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.168581    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f78f94c66-r4vxd"]
Jul 13 17:06:31.168776 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.168688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.171233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171078    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 17:06:31.171233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171103    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 17:06:31.171233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171116    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a3lidvljrdeva\""
Jul 13 17:06:31.171602 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rq48q\""
Jul 13 17:06:31.171700 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171644    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 17:06:31.171700 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.171671    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 17:06:31.211810 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.211716    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-client-certs\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.211971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.211823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-client-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.216003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.212048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-tls\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.216003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.212110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.216003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.212170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-audit-log\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.216003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.212231    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-metrics-server-audit-profiles\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.216003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.212292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh8b9\" (UniqueName: \"kubernetes.io/projected/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-kube-api-access-rh8b9\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.313715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-metrics-server-audit-profiles\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.313715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh8b9\" (UniqueName: \"kubernetes.io/projected/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-kube-api-access-rh8b9\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313802    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-client-certs\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-client-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-tls\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.313944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-audit-log\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314428 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.314295    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-audit-log\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.314887 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.314862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.315028 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.314901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-metrics-server-audit-profiles\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.316746 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.316717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-client-ca-bundle\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.316952 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.316934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-tls\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.317248 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.317225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-secret-metrics-server-client-certs\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.323388 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.323365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh8b9\" (UniqueName: \"kubernetes.io/projected/ac4376f2-c6ca-463a-9b2f-3c5caaabe7db-kube-api-access-rh8b9\") pod \"metrics-server-f78f94c66-r4vxd\" (UID: \"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db\") " pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.479253 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.479178    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:31.507873 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.507846    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"]
Jul 13 17:06:31.524865 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.524832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"]
Jul 13 17:06:31.525032 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.524958    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.527329 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.527304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c8c46\""
Jul 13 17:06:31.527849 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.527823    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 17:06:31.617880 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.617841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.618205 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.617987    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vvd\" (UniqueName: \"kubernetes.io/projected/7040f59f-b74f-4f3e-8686-94149aba2a3f-kube-api-access-c5vvd\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.718989 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.718946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.719444 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.719058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vvd\" (UniqueName: \"kubernetes.io/projected/7040f59f-b74f-4f3e-8686-94149aba2a3f-kube-api-access-c5vvd\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.719444 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:31.719139    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 17:06:31.719444 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:31.719216    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert podName:7040f59f-b74f-4f3e-8686-94149aba2a3f nodeName:}" failed. No retries permitted until 2026-07-13 17:06:32.219195674 +0000 UTC m=+61.977795504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-7vkpr" (UID: "7040f59f-b74f-4f3e-8686-94149aba2a3f") : secret "monitoring-plugin-cert" not found
Jul 13 17:06:31.728303 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.728273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vvd\" (UniqueName: \"kubernetes.io/projected/7040f59f-b74f-4f3e-8686-94149aba2a3f-kube-api-access-c5vvd\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:31.947256 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:31.947219    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f78f94c66-r4vxd"]
Jul 13 17:06:31.951808 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:31.951770    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4376f2_c6ca_463a_9b2f_3c5caaabe7db.slice/crio-0674e2e74635182b1f5c61d1f0dcdd51ea233f83f08873ae5d5e6fb694a9319d WatchSource:0}: Error finding container 0674e2e74635182b1f5c61d1f0dcdd51ea233f83f08873ae5d5e6fb694a9319d: Status 404 returned error can't find the container with id 0674e2e74635182b1f5c61d1f0dcdd51ea233f83f08873ae5d5e6fb694a9319d
Jul 13 17:06:32.052575 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:32.051045    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgk76"
Jul 13 17:06:32.143360 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:32.143268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd" event={"ID":"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db","Type":"ContainerStarted","Data":"0674e2e74635182b1f5c61d1f0dcdd51ea233f83f08873ae5d5e6fb694a9319d"}
Jul 13 17:06:32.147585 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:32.147138    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-66nmm" event={"ID":"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5","Type":"ContainerStarted","Data":"fcf595d2d1d8aa5d150e73886557a346bbee83472f709670a1ccef1a3f9a5ce5"}
Jul 13 17:06:32.225042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:32.224431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:32.225042 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:32.224566    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 17:06:32.225042 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:06:32.224648    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert podName:7040f59f-b74f-4f3e-8686-94149aba2a3f nodeName:}" failed. No retries permitted until 2026-07-13 17:06:33.224623479 +0000 UTC m=+62.983223289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-7vkpr" (UID: "7040f59f-b74f-4f3e-8686-94149aba2a3f") : secret "monitoring-plugin-cert" not found
Jul 13 17:06:33.028624 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.028590    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:06:33.032165 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.032141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.034628 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.034602    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-676ge6nm4v1mg\""
Jul 13 17:06:33.034786 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.034771    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 17:06:33.035004 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.034963    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 17:06:33.035085 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035051    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 17:06:33.035085 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035059    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 17:06:33.035186 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035069    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 17:06:33.035186 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035120    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 17:06:33.035186 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035168    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 17:06:33.035325 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.034983    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 17:06:33.035325 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035301    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5h46n\""
Jul 13 17:06:33.035408 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035399    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 17:06:33.035461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035408    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 17:06:33.035511 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035485    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 17:06:33.035563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.035546    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 17:06:33.045046 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.044999    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 17:06:33.045182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.045081    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 17:06:33.053307 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.053282    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:06:33.135090 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135059    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135204 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135204 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135148    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135204 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135204 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jk56\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135521 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135521 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135521 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135521 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135679 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135679 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135679 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135679 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135844 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135844 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135768    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.135844 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.135793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.153921 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.153892    2567 generic.go:356] "Generic (PLEG): container finished" podID="a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5" containerID="fcf595d2d1d8aa5d150e73886557a346bbee83472f709670a1ccef1a3f9a5ce5" exitCode=0
Jul 13 17:06:33.154041 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.153970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-66nmm" event={"ID":"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5","Type":"ContainerDied","Data":"fcf595d2d1d8aa5d150e73886557a346bbee83472f709670a1ccef1a3f9a5ce5"}
Jul 13 17:06:33.237250 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237250 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237276    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.237948 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.237596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238135    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jk56\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.238493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.238351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.241713 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.241673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.242831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.242799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.243292 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.243263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.243433 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.243410    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.244483 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.244161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.245044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.244613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.245516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.245492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.246089 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.245842    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.246205 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.246186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.246815 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.246679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.246984 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.246960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.247643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.247601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.248175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.248131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.249405 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.249337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.249501 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.249473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.249561 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.249507    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.249719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.249683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.250952 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.250847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7040f59f-b74f-4f3e-8686-94149aba2a3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7vkpr\" (UID: \"7040f59f-b74f-4f3e-8686-94149aba2a3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:33.251280 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.251232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jk56\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56\") pod \"prometheus-k8s-0\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.336837 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.336609    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:33.352688 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.352652    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:33.621933 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.621864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"]
Jul 13 17:06:33.654431 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:33.654315    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:06:34.161710 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.161667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl" event={"ID":"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb","Type":"ContainerStarted","Data":"adbc285beea7cfafdd052bbdd6fb0b7e5685ea81e6cadc478a698943ddb00318"}
Jul 13 17:06:34.162195 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.161732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl" event={"ID":"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb","Type":"ContainerStarted","Data":"56c15ee7ba03fe7ba63aaff72146777d714c0a0927835cc22553d39cf55935d7"}
Jul 13 17:06:34.163498 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.163403    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb" exitCode=0
Jul 13 17:06:34.163498 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.163436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb"}
Jul 13 17:06:34.166280 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.166256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-66nmm" event={"ID":"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5","Type":"ContainerStarted","Data":"de9e7b48286e38c1d44880d47a2aafde604da545f6a64f55ca452741cafa26bf"}
Jul 13 17:06:34.166361 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.166309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-66nmm" event={"ID":"a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5","Type":"ContainerStarted","Data":"88a91ef32fbdcd91f973946d723131fe021aff01ca84371dda2806cea464fbc8"}
Jul 13 17:06:34.168467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.168403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmwnm" event={"ID":"cab9ef09-1979-4872-94dc-916777fb56c6","Type":"ContainerStarted","Data":"11cbba74448b171e49aae78687dd868c6b4b3866308eebc333816fa2f4cfc5bd"}
Jul 13 17:06:34.171316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.171279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5" event={"ID":"6b511752-719b-433e-bb6f-6f924a880286","Type":"ContainerStarted","Data":"1d1897578b315f8221287ba91876f3cdc8951cb420a1b9b26528e1923ac776cd"}
Jul 13 17:06:34.213276 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.213206    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-66nmm" podStartSLOduration=6.762557254 podStartE2EDuration="8.213184796s" totalImagesPullingTime="1.361133982s" totalInitContainerRuntime="89.49356ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:34.212585468 +0000 UTC m=+63.971185300" watchObservedRunningTime="2026-07-13 17:06:34.213184796 +0000 UTC m=+63.971784623"
Jul 13 17:06:34.241959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:34.241901    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6wwg5" podStartSLOduration=6.081151338 podStartE2EDuration="8.241883605s" totalImagesPullingTime="2.160732267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:34.241381019 +0000 UTC m=+63.999980853" watchObservedRunningTime="2026-07-13 17:06:34.241883605 +0000 UTC m=+64.000483429"
Jul 13 17:06:34.564561 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:34.564524    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2a5584_e290_4f7e_ad94_9f824ab3eb3a.slice/crio-da308f0f71f659514b2a298af397f4174e84fd620d15667595d5f1a0d7e76290 WatchSource:0}: Error finding container da308f0f71f659514b2a298af397f4174e84fd620d15667595d5f1a0d7e76290: Status 404 returned error can't find the container with id da308f0f71f659514b2a298af397f4174e84fd620d15667595d5f1a0d7e76290
Jul 13 17:06:35.177458 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:35.177410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"da308f0f71f659514b2a298af397f4174e84fd620d15667595d5f1a0d7e76290"}
Jul 13 17:06:35.745578 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:35.745537    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7040f59f_b74f_4f3e_8686_94149aba2a3f.slice/crio-d59b6343a71b0c9b4b2dbfcadd898969e72ea9bda3520309dfda2efd755e9d43 WatchSource:0}: Error finding container d59b6343a71b0c9b4b2dbfcadd898969e72ea9bda3520309dfda2efd755e9d43: Status 404 returned error can't find the container with id d59b6343a71b0c9b4b2dbfcadd898969e72ea9bda3520309dfda2efd755e9d43
Jul 13 17:06:36.183981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.183943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl" event={"ID":"59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb","Type":"ContainerStarted","Data":"84b498c02b2c4d87df1ae18dfd51370f3328c6559cc90751f655115d893d99a6"}
Jul 13 17:06:36.185780 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.185745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr" event={"ID":"7040f59f-b74f-4f3e-8686-94149aba2a3f","Type":"ContainerStarted","Data":"d59b6343a71b0c9b4b2dbfcadd898969e72ea9bda3520309dfda2efd755e9d43"}
Jul 13 17:06:36.202556 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.202425    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-8ncsl" podStartSLOduration=7.92509881 podStartE2EDuration="10.202400019s" totalImagesPullingTime="2.277301209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:36.201001664 +0000 UTC m=+65.959601498" watchObservedRunningTime="2026-07-13 17:06:36.202400019 +0000 UTC m=+65.960999828"
Jul 13 17:06:36.575299 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.575214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:36.575451 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.575302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:36.577973 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.577809    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:06:36.577973 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.577906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:06:36.591554 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.591516    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a08b963-67ee-4331-9f33-939660d0e2e6-metrics-certs\") pod \"network-metrics-daemon-48lrl\" (UID: \"7a08b963-67ee-4331-9f33-939660d0e2e6\") " pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:36.591694 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.591576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1-original-pull-secret\") pod \"global-pull-secret-syncer-tplfd\" (UID: \"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1\") " pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:36.608864 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.608835    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5r2pv\""
Jul 13 17:06:36.611327 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.611301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tplfd"
Jul 13 17:06:36.617422 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.617394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48lrl"
Jul 13 17:06:36.675966 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.675926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:36.678740 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.678619    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:06:36.688799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.688768    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:06:36.700440 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:36.700406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrjf\" (UniqueName: \"kubernetes.io/projected/81368231-f10a-4f2d-9312-27b5170044aa-kube-api-access-nsrjf\") pod \"network-check-target-pjng8\" (UID: \"81368231-f10a-4f2d-9312-27b5170044aa\") " pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:37.001468 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:37.001442    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wvvhh\""
Jul 13 17:06:37.010266 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:37.010007    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:37.099854 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:37.099777    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48lrl"]
Jul 13 17:06:37.124192 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:37.124165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tplfd"]
Jul 13 17:06:37.363321 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:37.363233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a08b963_67ee_4331_9f33_939660d0e2e6.slice/crio-3465de0e78387ab26f69b6c7db6d872beac99775ffa936af51e12ff599f4ffe2 WatchSource:0}: Error finding container 3465de0e78387ab26f69b6c7db6d872beac99775ffa936af51e12ff599f4ffe2: Status 404 returned error can't find the container with id 3465de0e78387ab26f69b6c7db6d872beac99775ffa936af51e12ff599f4ffe2
Jul 13 17:06:37.366353 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:37.366315    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f9a1c4_9968_440b_bd35_d3f5b4bc9fe1.slice/crio-1882871736a92834b4d0be98828ad33fdfebf781ebd6d1caddb2745f33263681 WatchSource:0}: Error finding container 1882871736a92834b4d0be98828ad33fdfebf781ebd6d1caddb2745f33263681: Status 404 returned error can't find the container with id 1882871736a92834b4d0be98828ad33fdfebf781ebd6d1caddb2745f33263681
Jul 13 17:06:37.552184 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:37.552159    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjng8"]
Jul 13 17:06:37.556638 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:06:37.556608    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81368231_f10a_4f2d_9312_27b5170044aa.slice/crio-685742872bac00bd1939ecc6dad7500e56a4515aae8e5a28e56f4407b9821bc2 WatchSource:0}: Error finding container 685742872bac00bd1939ecc6dad7500e56a4515aae8e5a28e56f4407b9821bc2: Status 404 returned error can't find the container with id 685742872bac00bd1939ecc6dad7500e56a4515aae8e5a28e56f4407b9821bc2
Jul 13 17:06:38.196294 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.196260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dc66947c-6wpdm" event={"ID":"25707e61-cbdc-4002-bbd6-56d24dda998f","Type":"ContainerStarted","Data":"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"}
Jul 13 17:06:38.197697 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.197669    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="1e94c5a6f44db973d942893c128db55dfaf52f09de5436f2e411bc0c2b209a6e" exitCode=0
Jul 13 17:06:38.197822 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.197736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"1e94c5a6f44db973d942893c128db55dfaf52f09de5436f2e411bc0c2b209a6e"}
Jul 13 17:06:38.198924 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.198893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tplfd" event={"ID":"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1","Type":"ContainerStarted","Data":"1882871736a92834b4d0be98828ad33fdfebf781ebd6d1caddb2745f33263681"}
Jul 13 17:06:38.201252 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.201228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"4797acdb1fcd6207c7b4e4eca0eaa921bac89efa0189e64b3433ed611562e847"}
Jul 13 17:06:38.201334 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.201294    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"be4b77db4ced66ab29eb2337cf2c293e366b75273c3e196fe2b55bf6e0905902"}
Jul 13 17:06:38.201397 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.201340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"c92f54c7eb0a635b99bc8edd054456f858e939fcd602612d4f80bcdc0e772524"}
Jul 13 17:06:38.207896 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.207870    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd" event={"ID":"ac4376f2-c6ca-463a-9b2f-3c5caaabe7db","Type":"ContainerStarted","Data":"025791f24ac9f8a99331cc4f10722ef70f8cfbefd52382c02cd606e95e8887b1"}
Jul 13 17:06:38.209440 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.209407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48lrl" event={"ID":"7a08b963-67ee-4331-9f33-939660d0e2e6","Type":"ContainerStarted","Data":"3465de0e78387ab26f69b6c7db6d872beac99775ffa936af51e12ff599f4ffe2"}
Jul 13 17:06:38.215147 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.215122    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"}
Jul 13 17:06:38.215233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.215193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"}
Jul 13 17:06:38.215305 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.215235    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"}
Jul 13 17:06:38.216661 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.216635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjng8" event={"ID":"81368231-f10a-4f2d-9312-27b5170044aa","Type":"ContainerStarted","Data":"685742872bac00bd1939ecc6dad7500e56a4515aae8e5a28e56f4407b9821bc2"}
Jul 13 17:06:38.218740 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.218712    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmwnm" event={"ID":"cab9ef09-1979-4872-94dc-916777fb56c6","Type":"ContainerStarted","Data":"c61060a6ce51a1477f0132d92f4ff3132dbd0ee4305289d44a3496fd5e69ffb7"}
Jul 13 17:06:38.242904 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.242861    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bmwnm" podStartSLOduration=2.138331016 podStartE2EDuration="14.242846852s" totalImagesPullingTime="12.104515836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:06:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:38.242269828 +0000 UTC m=+68.000869651" watchObservedRunningTime="2026-07-13 17:06:38.242846852 +0000 UTC m=+68.001446665"
Jul 13 17:06:38.262999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.262948    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74dc66947c-6wpdm" podStartSLOduration=5.286244678 podStartE2EDuration="11.262929073s" totalImagesPullingTime="5.976684395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:38.260599634 +0000 UTC m=+68.019199458" watchObservedRunningTime="2026-07-13 17:06:38.262929073 +0000 UTC m=+68.021528906"
Jul 13 17:06:38.278456 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:38.278403    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd" podStartSLOduration=2.2751747 podStartE2EDuration="7.278387399s" totalImagesPullingTime="5.003212699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:38.277988668 +0000 UTC m=+68.036588501" watchObservedRunningTime="2026-07-13 17:06:38.278387399 +0000 UTC m=+68.036987231"
Jul 13 17:06:39.228495 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.228336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"}
Jul 13 17:06:39.228495 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.228426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"}
Jul 13 17:06:39.232357 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.232315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr" event={"ID":"7040f59f-b74f-4f3e-8686-94149aba2a3f","Type":"ContainerStarted","Data":"b4f75977649dabe29fde898fdb454d657be2340c3e214a7e84b74fd41791fa63"}
Jul 13 17:06:39.233120 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.233067    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:39.240218 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.240086    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr"
Jul 13 17:06:39.248203 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:39.248148    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7vkpr" podStartSLOduration=5.503284031 podStartE2EDuration="8.248125971s" totalImagesPullingTime="2.74484194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:39.24635521 +0000 UTC m=+69.004955079" watchObservedRunningTime="2026-07-13 17:06:39.248125971 +0000 UTC m=+69.006725812"
Jul 13 17:06:40.242126 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.242049    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"5bfdef6afed28d046837cc7f36428bcfaf974309e8659c200299350979b8bbed"}
Jul 13 17:06:40.242568 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.242220    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"eb2d106f8a9aed98faa7de6593682ac267906ee36483b105a79120ea9f5ca308"}
Jul 13 17:06:40.242568 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.242269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" event={"ID":"367a6524-936d-420f-ae2a-c5593dafe853","Type":"ContainerStarted","Data":"1583a3068db9fb6419267aadd948aa8c9b8e956e407da0b1034e608629b7fc49"}
Jul 13 17:06:40.242568 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.242413    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:40.245187 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.245157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48lrl" event={"ID":"7a08b963-67ee-4331-9f33-939660d0e2e6","Type":"ContainerStarted","Data":"bd39ddf82019520988f1da292c18da90be5241f4df1bae8740d003377871debf"}
Jul 13 17:06:40.245300 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.245210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48lrl" event={"ID":"7a08b963-67ee-4331-9f33-939660d0e2e6","Type":"ContainerStarted","Data":"5823369bf5680ce3ffa27f1d7321218ba5007e823b9977ed6799497e796592b8"}
Jul 13 17:06:40.251733 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.251699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerStarted","Data":"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"}
Jul 13 17:06:40.268735 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.268589    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm" podStartSLOduration=4.42034268 podStartE2EDuration="12.268569382s" totalImagesPullingTime="7.848226702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:40.265986694 +0000 UTC m=+70.024586532" watchObservedRunningTime="2026-07-13 17:06:40.268569382 +0000 UTC m=+70.027169216"
Jul 13 17:06:40.294961 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.294869    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.696775625 podStartE2EDuration="13.294847494s" totalImagesPullingTime="6.571172539s" totalInitContainerRuntime="26.89933ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:40.292514618 +0000 UTC m=+70.051114488" watchObservedRunningTime="2026-07-13 17:06:40.294847494 +0000 UTC m=+70.053447339"
Jul 13 17:06:40.316541 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:40.314705    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-48lrl" podStartSLOduration=67.128810169 podStartE2EDuration="1m9.314684065s" totalImagesPullingTime="2.185873896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:40.312849719 +0000 UTC m=+70.071449552" watchObservedRunningTime="2026-07-13 17:06:40.314684065 +0000 UTC m=+70.073283900"
Jul 13 17:06:41.149389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:41.149351    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-946mn"
Jul 13 17:06:44.298983 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.298936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjng8" event={"ID":"81368231-f10a-4f2d-9312-27b5170044aa","Type":"ContainerStarted","Data":"be1121e28278e605911495b4867ad1a58877aad142a3dc67c5fa019dc8f877e9"}
Jul 13 17:06:44.306462 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.306431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"e8633977e8cb2dc537932455a7ad013b86e5c3c5818322673aa47c78e33bca46"}
Jul 13 17:06:44.306649 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.306628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"45f199ec484fbc7a442f054db99f08d2cb602f97ee7bd7c7546609658eb14d9e"}
Jul 13 17:06:44.306747 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.306737    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"47a67f32ab3457139305e635d313ddc38a122aa1a35bc6f7e0933e44797db1a5"}
Jul 13 17:06:44.313878 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.313830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tplfd" event={"ID":"80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1","Type":"ContainerStarted","Data":"42bd54ad412ff2cca5385a4962d32916051d3a7bbd387dab6d82adab0030f333"}
Jul 13 17:06:44.317902 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.316558    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pjng8" podStartSLOduration=66.838371219 podStartE2EDuration="1m13.316539556s" totalImagesPullingTime="6.478168337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:44.315483249 +0000 UTC m=+74.074083085" watchObservedRunningTime="2026-07-13 17:06:44.316539556 +0000 UTC m=+74.075139389"
Jul 13 17:06:44.329084 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:44.328776    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tplfd" podStartSLOduration=66.648510714 podStartE2EDuration="1m13.328762792s" totalImagesPullingTime="6.680252078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:44.328536011 +0000 UTC m=+74.087135844" watchObservedRunningTime="2026-07-13 17:06:44.328762792 +0000 UTC m=+74.087362626"
Jul 13 17:06:45.321072 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:45.321029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"c50c7fadd0251389a3e4ea1410e75fad981fa19b93982ff6ba61c5a2d549ad51"}
Jul 13 17:06:45.321487 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:45.321099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"5a43ed192cd1fd87dc2644a8665147aea425f37a711385ccd56bd40d9047ac47"}
Jul 13 17:06:45.321487 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:45.321147    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:06:45.321487 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:45.321178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerStarted","Data":"a59a68bcd2f91e90073af80b157d9cead3d7953bf79451c15737b0f9ed220a7b"}
Jul 13 17:06:45.362613 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:45.362530    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.490505757 podStartE2EDuration="12.362506316s" totalImagesPullingTime="5.843980877s" totalInitContainerRuntime="28.019682ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:45.360390993 +0000 UTC m=+75.118990827" watchObservedRunningTime="2026-07-13 17:06:45.362506316 +0000 UTC m=+75.121106152"
Jul 13 17:06:46.263002 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:46.262973    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77d6dd6c99-b6vhm"
Jul 13 17:06:47.411919 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:47.411883    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:06:47.682991 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:47.682953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:06:48.354390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:48.354358    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:06:51.479806 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:51.479766    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:06:51.480218 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:06:51.479858    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:07:11.485287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:11.485175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:07:11.489139 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:11.489116    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f78f94c66-r4vxd"
Jul 13 17:07:12.432586 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:12.432526    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74dc66947c-6wpdm" podUID="25707e61-cbdc-4002-bbd6-56d24dda998f" containerName="console" containerID="cri-o://1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3" gracePeriod=15
Jul 13 17:07:13.201888 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.201859    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:07:13.297330 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297294    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297330 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297335    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297368    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sx28\" (UniqueName: \"kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297423    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297477    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config\") pod \"25707e61-cbdc-4002-bbd6-56d24dda998f\" (UID: \"25707e61-cbdc-4002-bbd6-56d24dda998f\") "
Jul 13 17:07:13.297807 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297776    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:13.297853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297814    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca" (OuterVolumeSpecName: "service-ca") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:13.297931 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.297898    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config" (OuterVolumeSpecName: "console-config") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:13.299820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.299788    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28" (OuterVolumeSpecName: "kube-api-access-9sx28") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "kube-api-access-9sx28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:13.300164 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.300139    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:13.300262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.300203    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25707e61-cbdc-4002-bbd6-56d24dda998f" (UID: "25707e61-cbdc-4002-bbd6-56d24dda998f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398641    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-console-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398674    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-oauth-serving-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398689    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-serving-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398701    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sx28\" (UniqueName: \"kubernetes.io/projected/25707e61-cbdc-4002-bbd6-56d24dda998f-kube-api-access-9sx28\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398713    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25707e61-cbdc-4002-bbd6-56d24dda998f-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.398732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.398725    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25707e61-cbdc-4002-bbd6-56d24dda998f-console-oauth-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:13.434191 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.434155    2567 generic.go:356] "Generic (PLEG): container finished" podID="25707e61-cbdc-4002-bbd6-56d24dda998f" containerID="1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3" exitCode=0
Jul 13 17:07:13.434322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.434220    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dc66947c-6wpdm"
Jul 13 17:07:13.434322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.434243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dc66947c-6wpdm" event={"ID":"25707e61-cbdc-4002-bbd6-56d24dda998f","Type":"ContainerDied","Data":"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"}
Jul 13 17:07:13.434322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.434296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dc66947c-6wpdm" event={"ID":"25707e61-cbdc-4002-bbd6-56d24dda998f","Type":"ContainerDied","Data":"65d46e995e70ec2ae43aec085525aab8d586c5fd4281bfcb3347f719fc55265f"}
Jul 13 17:07:13.434322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.434317    2567 scope.go:117] "RemoveContainer" containerID="1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"
Jul 13 17:07:13.443154 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.443136    2567 scope.go:117] "RemoveContainer" containerID="1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"
Jul 13 17:07:13.443387 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:13.443367    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3\": container with ID starting with 1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3 not found: ID does not exist" containerID="1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"
Jul 13 17:07:13.443440 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.443394    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3"} err="failed to get container status \"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3\": rpc error: code = NotFound desc = could not find container \"1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3\": container with ID starting with 1ec82222bab47b5bb317342c238075f2c940a368dedc8823f0440cdfc66f3fd3 not found: ID does not exist"
Jul 13 17:07:13.453438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.453412    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:07:13.456791 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:13.456768    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74dc66947c-6wpdm"]
Jul 13 17:07:14.894329 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:14.894289    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25707e61-cbdc-4002-bbd6-56d24dda998f" path="/var/lib/kubelet/pods/25707e61-cbdc-4002-bbd6-56d24dda998f/volumes"
Jul 13 17:07:16.328371 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:16.328339    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pjng8"
Jul 13 17:07:33.354402 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:33.354371    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:33.373410 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:33.373372    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:33.530687 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:33.530658    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:47.172054 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.171998    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172304    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="alertmanager" containerID="cri-o://f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d" gracePeriod=120
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172375    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-metric" containerID="cri-o://9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6" gracePeriod=120
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172404    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-web" containerID="cri-o://283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb" gracePeriod=120
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172435    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy" containerID="cri-o://7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf" gracePeriod=120
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172461    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="config-reloader" containerID="cri-o://1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8" gracePeriod=120
Jul 13 17:07:47.172598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.172523    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="prom-label-proxy" containerID="cri-o://285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58" gracePeriod=120
Jul 13 17:07:47.569457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569423    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58" exitCode=0
Jul 13 17:07:47.569457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569448    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6" exitCode=0
Jul 13 17:07:47.569457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569457    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf" exitCode=0
Jul 13 17:07:47.569457 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569464    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8" exitCode=0
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569469    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d" exitCode=0
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"}
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"}
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"}
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"}
Jul 13 17:07:47.569739 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:47.569637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"}
Jul 13 17:07:48.412654 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.412627    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:48.578968 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.578874    2567 generic.go:356] "Generic (PLEG): container finished" podID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerID="283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb" exitCode=0
Jul 13 17:07:48.579110 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.578966    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:48.579110 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.578965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"}
Jul 13 17:07:48.579110 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.579096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8907c406-bd14-4024-b6b2-931dfc3cf6c2","Type":"ContainerDied","Data":"522d7375232e68cfbb920528f0f1ac27d1c89f9f44fe46067aee8bd6d8716eea"}
Jul 13 17:07:48.579215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.579138    2567 scope.go:117] "RemoveContainer" containerID="285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"
Jul 13 17:07:48.586324 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.586305    2567 scope.go:117] "RemoveContainer" containerID="9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"
Jul 13 17:07:48.593082 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.593067    2567 scope.go:117] "RemoveContainer" containerID="7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"
Jul 13 17:07:48.599400 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.599379    2567 scope.go:117] "RemoveContainer" containerID="283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"
Jul 13 17:07:48.601418 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601401    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601503 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601437    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppbrw\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601503 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601462    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601503 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601489    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601518    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601558    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601590    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601617    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601677    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601711    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601756    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601783    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601814    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls\") pod \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\" (UID: \"8907c406-bd14-4024-b6b2-931dfc3cf6c2\") "
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601825    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:48.601867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.601840    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:48.602251 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.602077    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.602251 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.602095    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8907c406-bd14-4024-b6b2-931dfc3cf6c2-metrics-client-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.602959 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.602653    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:48.606327 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606293    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw" (OuterVolumeSpecName: "kube-api-access-ppbrw") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "kube-api-access-ppbrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:48.606411 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume" (OuterVolumeSpecName: "config-volume") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.606577 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606531    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:48.606655 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606599    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.607145 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606808    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.607145 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.606879    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.607145 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.607056    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.607343 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.607217    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out" (OuterVolumeSpecName: "config-out") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:48.608411 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.608370    2567 scope.go:117] "RemoveContainer" containerID="1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"
Jul 13 17:07:48.609505 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.609485    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.616840 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.616663    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config" (OuterVolumeSpecName: "web-config") pod "8907c406-bd14-4024-b6b2-931dfc3cf6c2" (UID: "8907c406-bd14-4024-b6b2-931dfc3cf6c2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:48.622824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.622810    2567 scope.go:117] "RemoveContainer" containerID="f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"
Jul 13 17:07:48.629372 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.629358    2567 scope.go:117] "RemoveContainer" containerID="aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb"
Jul 13 17:07:48.635844 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.635828    2567 scope.go:117] "RemoveContainer" containerID="285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"
Jul 13 17:07:48.636095 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.636077    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58\": container with ID starting with 285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58 not found: ID does not exist" containerID="285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"
Jul 13 17:07:48.636168 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636108    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58"} err="failed to get container status \"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58\": rpc error: code = NotFound desc = could not find container \"285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58\": container with ID starting with 285aba3a4b409f0ccc1179a33ecbdb9526db1d318212b3aa42a88f2242de8a58 not found: ID does not exist"
Jul 13 17:07:48.636168 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636134    2567 scope.go:117] "RemoveContainer" containerID="9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"
Jul 13 17:07:48.636392 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.636375    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6\": container with ID starting with 9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6 not found: ID does not exist" containerID="9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"
Jul 13 17:07:48.636437 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636400    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6"} err="failed to get container status \"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6\": rpc error: code = NotFound desc = could not find container \"9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6\": container with ID starting with 9206e4afb38737eca500ee3d5664c3dcd9b99b313827798e73ab960adf72bdc6 not found: ID does not exist"
Jul 13 17:07:48.636437 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636415    2567 scope.go:117] "RemoveContainer" containerID="7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"
Jul 13 17:07:48.636635 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.636617    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf\": container with ID starting with 7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf not found: ID does not exist" containerID="7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"
Jul 13 17:07:48.636678 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636641    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf"} err="failed to get container status \"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf\": rpc error: code = NotFound desc = could not find container \"7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf\": container with ID starting with 7d2d9cc531cc617a80169fcf3656dd29523a18045fa9aed3d2aad698514b0abf not found: ID does not exist"
Jul 13 17:07:48.636678 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636658    2567 scope.go:117] "RemoveContainer" containerID="283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"
Jul 13 17:07:48.636894 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.636877    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb\": container with ID starting with 283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb not found: ID does not exist" containerID="283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"
Jul 13 17:07:48.636932 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636898    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb"} err="failed to get container status \"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb\": rpc error: code = NotFound desc = could not find container \"283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb\": container with ID starting with 283b384dab31bd41d72cb51c1948bdafd715b9aefd6c465786fce6997ed2f6fb not found: ID does not exist"
Jul 13 17:07:48.636932 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.636912    2567 scope.go:117] "RemoveContainer" containerID="1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"
Jul 13 17:07:48.637157 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.637140    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8\": container with ID starting with 1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8 not found: ID does not exist" containerID="1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"
Jul 13 17:07:48.637212 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.637161    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8"} err="failed to get container status \"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8\": rpc error: code = NotFound desc = could not find container \"1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8\": container with ID starting with 1caa7767d85202808bac9e25a45c0130112fc5c3285d18248ed16d0caa8f23e8 not found: ID does not exist"
Jul 13 17:07:48.637212 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.637174    2567 scope.go:117] "RemoveContainer" containerID="f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"
Jul 13 17:07:48.637386 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.637370    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d\": container with ID starting with f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d not found: ID does not exist" containerID="f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"
Jul 13 17:07:48.637424 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.637390    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d"} err="failed to get container status \"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d\": rpc error: code = NotFound desc = could not find container \"f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d\": container with ID starting with f56f18b20b0897169a4b01e9fbf96d6e479a01337d400feb3c4293ea3214400d not found: ID does not exist"
Jul 13 17:07:48.637424 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.637403    2567 scope.go:117] "RemoveContainer" containerID="aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb"
Jul 13 17:07:48.637635 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:07:48.637618    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb\": container with ID starting with aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb not found: ID does not exist" containerID="aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb"
Jul 13 17:07:48.637677 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.637638    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb"} err="failed to get container status \"aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb\": rpc error: code = NotFound desc = could not find container \"aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb\": container with ID starting with aeedd1552037f9086de670c0339811ff802587eb73a4a92828add21e3e93acbb not found: ID does not exist"
Jul 13 17:07:48.703353 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703321    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-volume\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703353 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703350    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703362    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-cluster-tls-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703370    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-tls-assets\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703380    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703411    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-web-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703422    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-alertmanager-main-db\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703431    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703443    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8907c406-bd14-4024-b6b2-931dfc3cf6c2-config-out\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703451    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8907c406-bd14-4024-b6b2-931dfc3cf6c2-secret-alertmanager-main-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.703537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.703459    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppbrw\" (UniqueName: \"kubernetes.io/projected/8907c406-bd14-4024-b6b2-931dfc3cf6c2-kube-api-access-ppbrw\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:48.903141 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.903107    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:48.908872 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.908845    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:48.940392 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940360    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:48.940643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940629    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="init-config-reloader"
Jul 13 17:07:48.940643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940642    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="init-config-reloader"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940657    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25707e61-cbdc-4002-bbd6-56d24dda998f" containerName="console"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940662    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25707e61-cbdc-4002-bbd6-56d24dda998f" containerName="console"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940668    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940675    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940684    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="prom-label-proxy"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940689    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="prom-label-proxy"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940696    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="config-reloader"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940702    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="config-reloader"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940712    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="alertmanager"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940717    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="alertmanager"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940723    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-metric"
Jul 13 17:07:48.940727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940728    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-metric"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940738    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-web"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940743    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-web"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940785    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="config-reloader"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940793    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940798    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="alertmanager"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940803    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-metric"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940811    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="25707e61-cbdc-4002-bbd6-56d24dda998f" containerName="console"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940826    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="prom-label-proxy"
Jul 13 17:07:48.941121 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.940832    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" containerName="kube-rbac-proxy-web"
Jul 13 17:07:48.945169 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.945148    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:48.948530 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 17:07:48.948655 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948636    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 17:07:48.948734 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948670    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 17:07:48.948734 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n6m9g\""
Jul 13 17:07:48.948851 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 17:07:48.948912 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.948874    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 17:07:48.949085 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.949068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 17:07:48.949158 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.949094    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 17:07:48.949158 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.949149    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 17:07:48.955696 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.955680    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 17:07:48.964661 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:48.964640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:49.106179 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-config-out\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-web-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.106607 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.106540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjr4z\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-kube-api-access-pjr4z\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.207857 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-web-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.207978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208042 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjr4z\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-kube-api-access-pjr4z\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-config-out\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.208369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.208344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.209141 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.209113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.209263 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.209207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a07364-1fa3-404d-b977-8b91f6166b55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211095 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-web-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211402 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211620 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211600    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.211702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.211687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7a07364-1fa3-404d-b977-8b91f6166b55-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.212755 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.212737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7a07364-1fa3-404d-b977-8b91f6166b55-config-out\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.216880 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.216857    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjr4z\" (UniqueName: \"kubernetes.io/projected/a7a07364-1fa3-404d-b977-8b91f6166b55-kube-api-access-pjr4z\") pod \"alertmanager-main-0\" (UID: \"a7a07364-1fa3-404d-b977-8b91f6166b55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.254547 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.254517    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:07:49.392958 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.392924    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:07:49.396338 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:07:49.396310    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a07364_1fa3_404d_b977_8b91f6166b55.slice/crio-fc384f020e6a8f2002fec0b7513ea01d7158790181bf12760140833af14198d4 WatchSource:0}: Error finding container fc384f020e6a8f2002fec0b7513ea01d7158790181bf12760140833af14198d4: Status 404 returned error can't find the container with id fc384f020e6a8f2002fec0b7513ea01d7158790181bf12760140833af14198d4
Jul 13 17:07:49.584083 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.584045    2567 generic.go:356] "Generic (PLEG): container finished" podID="a7a07364-1fa3-404d-b977-8b91f6166b55" containerID="f5c2cb7c2ccf8a2bbfc1049822e39d1f8994c4a19c167e4bc89182d517897e97" exitCode=0
Jul 13 17:07:49.584502 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.584089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerDied","Data":"f5c2cb7c2ccf8a2bbfc1049822e39d1f8994c4a19c167e4bc89182d517897e97"}
Jul 13 17:07:49.584502 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:49.584177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"fc384f020e6a8f2002fec0b7513ea01d7158790181bf12760140833af14198d4"}
Jul 13 17:07:50.592493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592460    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"692176f5f6215b9f0d2a7d4ced31ac2938b9ee30fb63f14d550a641f17eb000c"}
Jul 13 17:07:50.592879 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"03b3a40321e004706d10abe95e7df29f7503fe8acdc7fd82677a82b7852f7ff1"}
Jul 13 17:07:50.592879 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"c8e751fdb01acf2a34d53d692764d4b6ac2d1cfa11720ad16b21f5dc813d7891"}
Jul 13 17:07:50.592879 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"c86fc581ae5daf07e2e9278cb61c18eae6a1a4caa278eca8a261971a90455dcd"}
Jul 13 17:07:50.592879 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"382d78962a9db771571f590a152265758d163ffbe88975ecb9ec035de9ab4ba2"}
Jul 13 17:07:50.592879 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.592623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7a07364-1fa3-404d-b977-8b91f6166b55","Type":"ContainerStarted","Data":"19298b7ab6b9aef332c89d5ea939818e2582aa161bbb7dd70756ba3ce21fcc10"}
Jul 13 17:07:50.624983 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.624871    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6099697539999998 podStartE2EDuration="2.624852195s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.882441ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:07:50.623363122 +0000 UTC m=+140.381962956" watchObservedRunningTime="2026-07-13 17:07:50.624852195 +0000 UTC m=+140.383452027"
Jul 13 17:07:50.894583 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:50.894503    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8907c406-bd14-4024-b6b2-931dfc3cf6c2" path="/var/lib/kubelet/pods/8907c406-bd14-4024-b6b2-931dfc3cf6c2/volumes"
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.455165    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.455698    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="prometheus" containerID="cri-o://47a67f32ab3457139305e635d313ddc38a122aa1a35bc6f7e0933e44797db1a5" gracePeriod=600
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.456006    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy" containerID="cri-o://5a43ed192cd1fd87dc2644a8665147aea425f37a711385ccd56bd40d9047ac47" gracePeriod=600
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.456118    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-web" containerID="cri-o://a59a68bcd2f91e90073af80b157d9cead3d7953bf79451c15737b0f9ed220a7b" gracePeriod=600
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.456180    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="config-reloader" containerID="cri-o://45f199ec484fbc7a442f054db99f08d2cb602f97ee7bd7c7546609658eb14d9e" gracePeriod=600
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.456239    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c50c7fadd0251389a3e4ea1410e75fad981fa19b93982ff6ba61c5a2d549ad51" gracePeriod=600
Jul 13 17:07:51.457615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.456308    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="thanos-sidecar" containerID="cri-o://e8633977e8cb2dc537932455a7ad013b86e5c3c5818322673aa47c78e33bca46" gracePeriod=600
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599739    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="c50c7fadd0251389a3e4ea1410e75fad981fa19b93982ff6ba61c5a2d549ad51" exitCode=0
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599763    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="5a43ed192cd1fd87dc2644a8665147aea425f37a711385ccd56bd40d9047ac47" exitCode=0
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599771    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="a59a68bcd2f91e90073af80b157d9cead3d7953bf79451c15737b0f9ed220a7b" exitCode=0
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599778    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="e8633977e8cb2dc537932455a7ad013b86e5c3c5818322673aa47c78e33bca46" exitCode=0
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599783    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="45f199ec484fbc7a442f054db99f08d2cb602f97ee7bd7c7546609658eb14d9e" exitCode=0
Jul 13 17:07:51.599769 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599789    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerID="47a67f32ab3457139305e635d313ddc38a122aa1a35bc6f7e0933e44797db1a5" exitCode=0
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"c50c7fadd0251389a3e4ea1410e75fad981fa19b93982ff6ba61c5a2d549ad51"}
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"5a43ed192cd1fd87dc2644a8665147aea425f37a711385ccd56bd40d9047ac47"}
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"a59a68bcd2f91e90073af80b157d9cead3d7953bf79451c15737b0f9ed220a7b"}
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.599999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"e8633977e8cb2dc537932455a7ad013b86e5c3c5818322673aa47c78e33bca46"}
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.600059    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"45f199ec484fbc7a442f054db99f08d2cb602f97ee7bd7c7546609658eb14d9e"}
Jul 13 17:07:51.600322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.600099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"47a67f32ab3457139305e635d313ddc38a122aa1a35bc6f7e0933e44797db1a5"}
Jul 13 17:07:51.701774 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.701750    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:51.832338 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832249    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832338 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832295    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832338 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832321    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832354    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832378    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832400    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832464    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832505    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832592 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832565    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832596    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832625    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832651    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832719    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832758    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832790    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832813    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jk56\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.832981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832885    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config\") pod \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\" (UID: \"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a\") "
Jul 13 17:07:51.833494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.833192    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832838    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.832873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.833793    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.834168    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.834497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.834755    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.835585    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:51.835648 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.835460    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.836164 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.835712    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.836164 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.835857    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config" (OuterVolumeSpecName: "config") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.836297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.836273    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.836379 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.836349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:51.836638 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.836597    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.837124 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.837096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.837245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.837224    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.837378 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.837363    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out" (OuterVolumeSpecName: "config-out") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:51.837618 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.837601    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.838394 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.838374    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56" (OuterVolumeSpecName: "kube-api-access-2jk56") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "kube-api-access-2jk56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:51.846908 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.846888    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config" (OuterVolumeSpecName: "web-config") pod "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" (UID: "8d2a5584-e290-4f7e-ad94-9f824ab3eb3a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:07:51.933819 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933779    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.933819 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933811    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933822    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933847    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-metrics-client-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933856    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933865    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-db\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933873    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933882    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933890    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-grpc-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933898    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-tls-assets\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933905    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933913    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-web-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933921    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-kube-rbac-proxy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933929    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config-out\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933937    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933945    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-secret-metrics-client-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933953    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933962    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jk56\" (UniqueName: \"kubernetes.io/projected/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-kube-api-access-2jk56\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:51.934009 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:51.933970    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a-config\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:07:52.607189 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.607157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d2a5584-e290-4f7e-ad94-9f824ab3eb3a","Type":"ContainerDied","Data":"da308f0f71f659514b2a298af397f4174e84fd620d15667595d5f1a0d7e76290"}
Jul 13 17:07:52.607605 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.607219    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.607605 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.607232    2567 scope.go:117] "RemoveContainer" containerID="c50c7fadd0251389a3e4ea1410e75fad981fa19b93982ff6ba61c5a2d549ad51"
Jul 13 17:07:52.614759 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.614744    2567 scope.go:117] "RemoveContainer" containerID="5a43ed192cd1fd87dc2644a8665147aea425f37a711385ccd56bd40d9047ac47"
Jul 13 17:07:52.621564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.621546    2567 scope.go:117] "RemoveContainer" containerID="a59a68bcd2f91e90073af80b157d9cead3d7953bf79451c15737b0f9ed220a7b"
Jul 13 17:07:52.627943 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.627927    2567 scope.go:117] "RemoveContainer" containerID="e8633977e8cb2dc537932455a7ad013b86e5c3c5818322673aa47c78e33bca46"
Jul 13 17:07:52.630924 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.630904    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:52.636382 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.636361    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:52.637931 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.637901    2567 scope.go:117] "RemoveContainer" containerID="45f199ec484fbc7a442f054db99f08d2cb602f97ee7bd7c7546609658eb14d9e"
Jul 13 17:07:52.644496 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.644479    2567 scope.go:117] "RemoveContainer" containerID="47a67f32ab3457139305e635d313ddc38a122aa1a35bc6f7e0933e44797db1a5"
Jul 13 17:07:52.651514 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.651493    2567 scope.go:117] "RemoveContainer" containerID="1e94c5a6f44db973d942893c128db55dfaf52f09de5436f2e411bc0c2b209a6e"
Jul 13 17:07:52.661141 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661118    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:52.661631 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661615    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="init-config-reloader"
Jul 13 17:07:52.661732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661723    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="init-config-reloader"
Jul 13 17:07:52.661813 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661804    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-thanos"
Jul 13 17:07:52.661877 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661869    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-thanos"
Jul 13 17:07:52.661943 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661934    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-web"
Jul 13 17:07:52.662006 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.661998    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-web"
Jul 13 17:07:52.662113 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662102    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy"
Jul 13 17:07:52.662181 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662173    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy"
Jul 13 17:07:52.662248 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662240    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="thanos-sidecar"
Jul 13 17:07:52.662306 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662298    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="thanos-sidecar"
Jul 13 17:07:52.662377 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662369    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="prometheus"
Jul 13 17:07:52.662441 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662434    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="prometheus"
Jul 13 17:07:52.662524 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662515    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="config-reloader"
Jul 13 17:07:52.662589 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662581    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="config-reloader"
Jul 13 17:07:52.662732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662723    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy"
Jul 13 17:07:52.662803 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662795    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="prometheus"
Jul 13 17:07:52.662867 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662859    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="config-reloader"
Jul 13 17:07:52.662928 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662920    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="thanos-sidecar"
Jul 13 17:07:52.662989 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.662981    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-web"
Jul 13 17:07:52.663078 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.663068    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" containerName="kube-rbac-proxy-thanos"
Jul 13 17:07:52.667767 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.667748    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.669792 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.669771    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5h46n\""
Jul 13 17:07:52.669901 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.669883    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-676ge6nm4v1mg\""
Jul 13 17:07:52.669961 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.669890    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 17:07:52.669961 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.669941    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 17:07:52.670181 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670155    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 17:07:52.670259 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670249    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 17:07:52.670312 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670274    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 17:07:52.670353 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670309    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 17:07:52.670353 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670309    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 17:07:52.670567 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670547    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 17:07:52.670710 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670695    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 17:07:52.670795 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670778    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 17:07:52.670951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670925    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 17:07:52.671039 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.670948    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 17:07:52.673272 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.673253    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 17:07:52.676539 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.676521    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 17:07:52.679496 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.679475    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:52.841340 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841340 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841340 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841483    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjtl\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-kube-api-access-zwjtl\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841697    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.841858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.842179 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.841866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.894354 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.894319    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d2a5584-e290-4f7e-ad94-9f824ab3eb3a" path="/var/lib/kubelet/pods/8d2a5584-e290-4f7e-ad94-9f824ab3eb3a/volumes"
Jul 13 17:07:52.943198 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjtl\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-kube-api-access-zwjtl\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943684 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.943945 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.943690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.944949 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.944918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.945092 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.944985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.945092 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.945074    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.945297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.945246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.945668 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.945643    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.946583 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.946557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.948190 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.948160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.948395 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.948270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.948589 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.948572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.948866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.949180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.949362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.949774    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.950454    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.950619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.950865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.952890 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.951263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.953722 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.953692    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.953886 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.953863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8bbe0bf-3761-4950-bcf6-c09b7c369213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.954543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.954524    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8bbe0bf-3761-4950-bcf6-c09b7c369213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.954636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.954524    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8bbe0bf-3761-4950-bcf6-c09b7c369213-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.954636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.954572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.957183 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.957159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjtl\" (UniqueName: \"kubernetes.io/projected/e8bbe0bf-3761-4950-bcf6-c09b7c369213-kube-api-access-zwjtl\") pod \"prometheus-k8s-0\" (UID: \"e8bbe0bf-3761-4950-bcf6-c09b7c369213\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:52.978103 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:52.978080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:07:53.126657 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:53.126629    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:07:53.128716 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:07:53.128692    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bbe0bf_3761_4950_bcf6_c09b7c369213.slice/crio-58b2261ab961e7f6bb2ea064625c47007f7201cd40c383d6ca1317bbc9af2481 WatchSource:0}: Error finding container 58b2261ab961e7f6bb2ea064625c47007f7201cd40c383d6ca1317bbc9af2481: Status 404 returned error can't find the container with id 58b2261ab961e7f6bb2ea064625c47007f7201cd40c383d6ca1317bbc9af2481
Jul 13 17:07:53.612068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:53.612034    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8bbe0bf-3761-4950-bcf6-c09b7c369213" containerID="cb1cb336acccc3437fafd69aaadbe9eda011f8facabf2308543e60a23ab65466" exitCode=0
Jul 13 17:07:53.612466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:53.612110    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerDied","Data":"cb1cb336acccc3437fafd69aaadbe9eda011f8facabf2308543e60a23ab65466"}
Jul 13 17:07:53.612466 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:53.612178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"58b2261ab961e7f6bb2ea064625c47007f7201cd40c383d6ca1317bbc9af2481"}
Jul 13 17:07:54.620939 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.620903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"4fe5e3c590e0e50390ba51a3ecb9d230ca940953672166b2d17165c3f32dcb34"}
Jul 13 17:07:54.621404 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.620972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"25980df68d09dcc8825db9b5160a28aaf6ffa226774ce6157a410bb0342c1e12"}
Jul 13 17:07:54.621404 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.620999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"da04c75c0a558728b6a5b0d3c2c588872ffa9e3a781d5f0851063863c51786ef"}
Jul 13 17:07:54.621404 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.621046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"329e55bd00fbcf33d8506d3525fafdf822fe930fb6d7c8c4631b1219662451ac"}
Jul 13 17:07:54.621404 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.621073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"541f5d90bf5120bd5f30bbdc9ace169e81e3f53c56118c159b901bfe27a5f0f1"}
Jul 13 17:07:54.621404 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.621096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8bbe0bf-3761-4950-bcf6-c09b7c369213","Type":"ContainerStarted","Data":"086c844a16c1a14c2df37726a8757d4c0f9e8703b3ef6f3619372238627a8e00"}
Jul 13 17:07:54.648481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:54.648428    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6306847639999997 podStartE2EDuration="2.648411267s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.726503ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:07:54.647445488 +0000 UTC m=+144.406045320" watchObservedRunningTime="2026-07-13 17:07:54.648411267 +0000 UTC m=+144.407011098"
Jul 13 17:07:57.979178 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:07:57.979137    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:08:52.978270 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:08:52.978231    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:08:52.993774 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:08:52.993742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:08:53.868954 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:08:53.868922    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:10:30.737635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:10:30.737609    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:10:30.740997 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:10:30.740976    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 17:10:30.747062 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:10:30.747039    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:11:10.034401 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.034361    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9z7v2"]
Jul 13 17:11:10.041004 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.040982    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.043331 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.043308    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 17:11:10.043441 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.043308    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 17:11:10.043647 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.043628    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gl422\""
Jul 13 17:11:10.047582 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.047555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9z7v2"]
Jul 13 17:11:10.113141 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.113103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.113315 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.113196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csr4d\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-kube-api-access-csr4d\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.214541 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.214501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.214704 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.214598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csr4d\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-kube-api-access-csr4d\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.222764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.222736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.223057 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.223035    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csr4d\" (UniqueName: \"kubernetes.io/projected/09bd2db7-cac1-45b8-95c3-09e45a641d6d-kube-api-access-csr4d\") pod \"cert-manager-55b4d954d5-9z7v2\" (UID: \"09bd2db7-cac1-45b8-95c3-09e45a641d6d\") " pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.362623 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.362547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9z7v2"
Jul 13 17:11:10.486198 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.486160    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9z7v2"]
Jul 13 17:11:10.489254 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:11:10.489229    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09bd2db7_cac1_45b8_95c3_09e45a641d6d.slice/crio-88af30ad14f87e8af64876619770f612d34112e732daf99c6cba17938699986e WatchSource:0}: Error finding container 88af30ad14f87e8af64876619770f612d34112e732daf99c6cba17938699986e: Status 404 returned error can't find the container with id 88af30ad14f87e8af64876619770f612d34112e732daf99c6cba17938699986e
Jul 13 17:11:10.491225 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:10.491209    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:11:11.367355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:11.367312    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9z7v2" event={"ID":"09bd2db7-cac1-45b8-95c3-09e45a641d6d","Type":"ContainerStarted","Data":"88af30ad14f87e8af64876619770f612d34112e732daf99c6cba17938699986e"}
Jul 13 17:11:12.377355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.377318    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"]
Jul 13 17:11:12.382217 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.382194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.384096 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.384009    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:11:12.384465 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.384446    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pkps4\""
Jul 13 17:11:12.384465 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.384460    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 17:11:12.392927 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.392902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"]
Jul 13 17:11:12.433613 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.433576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dn2z\" (UniqueName: \"kubernetes.io/projected/9415432c-01fd-453b-a885-d1fff2c8dc61-kube-api-access-9dn2z\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.433791 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.433689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9415432c-01fd-453b-a885-d1fff2c8dc61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.534553 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.534511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dn2z\" (UniqueName: \"kubernetes.io/projected/9415432c-01fd-453b-a885-d1fff2c8dc61-kube-api-access-9dn2z\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.534720 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.534570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9415432c-01fd-453b-a885-d1fff2c8dc61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.534979 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.534960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9415432c-01fd-453b-a885-d1fff2c8dc61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.546542 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.546508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dn2z\" (UniqueName: \"kubernetes.io/projected/9415432c-01fd-453b-a885-d1fff2c8dc61-kube-api-access-9dn2z\") pod \"openshift-lws-operator-fd8ccff4c-fv9fp\" (UID: \"9415432c-01fd-453b-a885-d1fff2c8dc61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:12.693496 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:12.693460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"
Jul 13 17:11:13.565605 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:13.565579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp"]
Jul 13 17:11:13.568474 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:11:13.568443    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9415432c_01fd_453b_a885_d1fff2c8dc61.slice/crio-bb854aae923da8b9ba39416549136bff3cf216fbc1034db25cc24824e4cf9f7e WatchSource:0}: Error finding container bb854aae923da8b9ba39416549136bff3cf216fbc1034db25cc24824e4cf9f7e: Status 404 returned error can't find the container with id bb854aae923da8b9ba39416549136bff3cf216fbc1034db25cc24824e4cf9f7e
Jul 13 17:11:14.384312 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:14.384239    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9z7v2" event={"ID":"09bd2db7-cac1-45b8-95c3-09e45a641d6d","Type":"ContainerStarted","Data":"1f155e1efb4b62ec33f0528f064d516bdc13707d8219dd0ce4b8117cdb83fe96"}
Jul 13 17:11:14.386207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:14.386173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp" event={"ID":"9415432c-01fd-453b-a885-d1fff2c8dc61","Type":"ContainerStarted","Data":"bb854aae923da8b9ba39416549136bff3cf216fbc1034db25cc24824e4cf9f7e"}
Jul 13 17:11:14.399800 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:14.399497    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9z7v2" podStartSLOduration=1.379680069 podStartE2EDuration="4.399475888s" totalImagesPullingTime="3.019795819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:14.398579453 +0000 UTC m=+344.157179287" watchObservedRunningTime="2026-07-13 17:11:14.399475888 +0000 UTC m=+344.158075722"
Jul 13 17:11:16.396559 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:16.396458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp" event={"ID":"9415432c-01fd-453b-a885-d1fff2c8dc61","Type":"ContainerStarted","Data":"dab84ea5e5452c457ad929f126614fb66fb63c9126d6bec01e19fe3c0904dacb"}
Jul 13 17:11:16.411328 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:16.411278    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fv9fp" podStartSLOduration=1.846558329 podStartE2EDuration="4.411260424s" totalImagesPullingTime="2.564702095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:16.410466905 +0000 UTC m=+346.169066739" watchObservedRunningTime="2026-07-13 17:11:16.411260424 +0000 UTC m=+346.169860265"
Jul 13 17:11:31.973241 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.973209    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"]
Jul 13 17:11:31.976632 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.976615    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:31.978344 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.978311    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 17:11:31.978583 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.978567    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 17:11:31.978726 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.978708    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 17:11:31.978870 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.978849    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 17:11:31.978998 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.978908    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kx26v\""
Jul 13 17:11:31.991994 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:31.991969    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"]
Jul 13 17:11:32.099873 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.099834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-manifests\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.100081 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.099887    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.100081 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.099943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.100081 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.099968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2kt9\" (UniqueName: \"kubernetes.io/projected/10e529f0-df8d-4c77-a48b-2bad00bf64cf-kube-api-access-d2kt9\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.100213 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.100079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-tmp\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201159 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-tmp\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-manifests\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201355 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2kt9\" (UniqueName: \"kubernetes.io/projected/10e529f0-df8d-4c77-a48b-2bad00bf64cf-kube-api-access-d2kt9\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.201636 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.201600    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-manifests\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.203389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.203362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10e529f0-df8d-4c77-a48b-2bad00bf64cf-tmp\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.203609 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.203592    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.203750 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.203731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10e529f0-df8d-4c77-a48b-2bad00bf64cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.210135 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.210114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2kt9\" (UniqueName: \"kubernetes.io/projected/10e529f0-df8d-4c77-a48b-2bad00bf64cf-kube-api-access-d2kt9\") pod \"opendatahub-operator-controller-manager-dfb6c5f74-twtpp\" (UID: \"10e529f0-df8d-4c77-a48b-2bad00bf64cf\") " pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.286877 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.286789    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:32.424768 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.424735    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"]
Jul 13 17:11:32.427818 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:11:32.427784    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e529f0_df8d_4c77_a48b_2bad00bf64cf.slice/crio-70a4b60bc6f8efcda73b3949a2590c5851031e2728a9600ae34dd341db4cf4f3 WatchSource:0}: Error finding container 70a4b60bc6f8efcda73b3949a2590c5851031e2728a9600ae34dd341db4cf4f3: Status 404 returned error can't find the container with id 70a4b60bc6f8efcda73b3949a2590c5851031e2728a9600ae34dd341db4cf4f3
Jul 13 17:11:32.457838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:32.457806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp" event={"ID":"10e529f0-df8d-4c77-a48b-2bad00bf64cf","Type":"ContainerStarted","Data":"70a4b60bc6f8efcda73b3949a2590c5851031e2728a9600ae34dd341db4cf4f3"}
Jul 13 17:11:36.480655 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:36.480605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp" event={"ID":"10e529f0-df8d-4c77-a48b-2bad00bf64cf","Type":"ContainerStarted","Data":"a3b79865b920b2dea01e70014b19e7b3713cf1b8f76f5c4c2b1d3b7e9f5fee19"}
Jul 13 17:11:37.486173 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:37.486140    2567 generic.go:356] "Generic (PLEG): container finished" podID="10e529f0-df8d-4c77-a48b-2bad00bf64cf" containerID="a3b79865b920b2dea01e70014b19e7b3713cf1b8f76f5c4c2b1d3b7e9f5fee19" exitCode=0
Jul 13 17:11:37.486553 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:37.486189    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp" event={"ID":"10e529f0-df8d-4c77-a48b-2bad00bf64cf","Type":"ContainerDied","Data":"a3b79865b920b2dea01e70014b19e7b3713cf1b8f76f5c4c2b1d3b7e9f5fee19"}
Jul 13 17:11:38.495674 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:38.495637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp" event={"ID":"10e529f0-df8d-4c77-a48b-2bad00bf64cf","Type":"ContainerStarted","Data":"3683eb7494c8adbe2fc99b7b80a2a25b1010134539d235ac9717e4b9310ffd3d"}
Jul 13 17:11:38.496109 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:38.495787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:38.517092 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:38.517004    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp" podStartSLOduration=2.427915148 podStartE2EDuration="7.516987878s" totalImagesPullingTime="4.07639785s" totalInitContainerRuntime="1.01267488s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:38.516965751 +0000 UTC m=+368.275565583" watchObservedRunningTime="2026-07-13 17:11:38.516987878 +0000 UTC m=+368.275587711"
Jul 13 17:11:49.501799 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:49.501768    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dfb6c5f74-twtpp"
Jul 13 17:11:52.229875 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.229833    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"]
Jul 13 17:11:52.240399 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.240373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.242570 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.242543    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 17:11:52.242570 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.242567    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 17:11:52.242760 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.242656    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 17:11:52.243025 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.242990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 17:11:52.243091 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.243065    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wpp9f\""
Jul 13 17:11:52.247306 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.247283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"]
Jul 13 17:11:52.321899 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.321856    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"]
Jul 13 17:11:52.325351 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.325329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.327937 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.327916    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fth2m\""
Jul 13 17:11:52.328193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.328177    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 17:11:52.328551 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.328537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 17:11:52.328730 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.328704    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 17:11:52.341214 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.341192    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"]
Jul 13 17:11:52.374797 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.374765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5311167d-f8f2-4614-a0d6-241fb02364fb-tls-certs\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.374938 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.374801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5311167d-f8f2-4614-a0d6-241fb02364fb-tmp\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.374938 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.374896    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz86k\" (UniqueName: \"kubernetes.io/projected/5311167d-f8f2-4614-a0d6-241fb02364fb-kube-api-access-cz86k\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.475863 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz86k\" (UniqueName: \"kubernetes.io/projected/5311167d-f8f2-4614-a0d6-241fb02364fb-kube-api-access-cz86k\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.476050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c54fd267-0742-45c9-acd1-6442dcc44efc-manager-config\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.476050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5311167d-f8f2-4614-a0d6-241fb02364fb-tls-certs\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.476050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5311167d-f8f2-4614-a0d6-241fb02364fb-tmp\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.476050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.476050 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.475976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lspl\" (UniqueName: \"kubernetes.io/projected/c54fd267-0742-45c9-acd1-6442dcc44efc-kube-api-access-6lspl\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.476311 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.476100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-metrics-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.478262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.478238    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5311167d-f8f2-4614-a0d6-241fb02364fb-tmp\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.478408 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.478387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5311167d-f8f2-4614-a0d6-241fb02364fb-tls-certs\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.483254 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.483202    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz86k\" (UniqueName: \"kubernetes.io/projected/5311167d-f8f2-4614-a0d6-241fb02364fb-kube-api-access-cz86k\") pod \"kube-auth-proxy-746dfd5849-jjv9b\" (UID: \"5311167d-f8f2-4614-a0d6-241fb02364fb\") " pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.550732 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.550703    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"
Jul 13 17:11:52.576842 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.576806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c54fd267-0742-45c9-acd1-6442dcc44efc-manager-config\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.576975 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.576851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.576975 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.576882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lspl\" (UniqueName: \"kubernetes.io/projected/c54fd267-0742-45c9-acd1-6442dcc44efc-kube-api-access-6lspl\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.576975 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.576927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-metrics-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.577565 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.577539    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c54fd267-0742-45c9-acd1-6442dcc44efc-manager-config\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.579443 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.579415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.579443 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.579429    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54fd267-0742-45c9-acd1-6442dcc44efc-metrics-cert\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.585360 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.585319    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lspl\" (UniqueName: \"kubernetes.io/projected/c54fd267-0742-45c9-acd1-6442dcc44efc-kube-api-access-6lspl\") pod \"lws-controller-manager-f6649c567-k4ffv\" (UID: \"c54fd267-0742-45c9-acd1-6442dcc44efc\") " pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.635420 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.635391    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:52.688908 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.688836    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b"]
Jul 13 17:11:52.691296 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:11:52.691250    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5311167d_f8f2_4614_a0d6_241fb02364fb.slice/crio-a33e7fc610aec2d3090e6f0ff581662086d80b8575fe8439ae85a11e6b58b34c WatchSource:0}: Error finding container a33e7fc610aec2d3090e6f0ff581662086d80b8575fe8439ae85a11e6b58b34c: Status 404 returned error can't find the container with id a33e7fc610aec2d3090e6f0ff581662086d80b8575fe8439ae85a11e6b58b34c
Jul 13 17:11:52.765989 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:52.765964    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"]
Jul 13 17:11:52.768539 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:11:52.768503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54fd267_0742_45c9_acd1_6442dcc44efc.slice/crio-fd54a8e6743ca8398947001fb818cdb77fd1e0f43a49c28ed7cc0f48420aaff2 WatchSource:0}: Error finding container fd54a8e6743ca8398947001fb818cdb77fd1e0f43a49c28ed7cc0f48420aaff2: Status 404 returned error can't find the container with id fd54a8e6743ca8398947001fb818cdb77fd1e0f43a49c28ed7cc0f48420aaff2
Jul 13 17:11:53.561058 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:53.560992    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv" event={"ID":"c54fd267-0742-45c9-acd1-6442dcc44efc","Type":"ContainerStarted","Data":"fd54a8e6743ca8398947001fb818cdb77fd1e0f43a49c28ed7cc0f48420aaff2"}
Jul 13 17:11:53.562337 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:53.562307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b" event={"ID":"5311167d-f8f2-4614-a0d6-241fb02364fb","Type":"ContainerStarted","Data":"a33e7fc610aec2d3090e6f0ff581662086d80b8575fe8439ae85a11e6b58b34c"}
Jul 13 17:11:54.569063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:54.569023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv" event={"ID":"c54fd267-0742-45c9-acd1-6442dcc44efc","Type":"ContainerStarted","Data":"2a00e8c32d516efa7f800ff910c4774d71823866e338fd39168c767fe51c449c"}
Jul 13 17:11:54.569514 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:54.569173    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:11:54.584063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:54.583986    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv" podStartSLOduration=0.939074262 podStartE2EDuration="2.58396683s" totalImagesPullingTime="1.644892568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:54.583639184 +0000 UTC m=+384.342239040" watchObservedRunningTime="2026-07-13 17:11:54.58396683 +0000 UTC m=+384.342566663"
Jul 13 17:11:56.585210 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:56.585173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b" event={"ID":"5311167d-f8f2-4614-a0d6-241fb02364fb","Type":"ContainerStarted","Data":"7a2514ea4effed1cf463d13cd332264a7b7ceb69118d987099df66a6a109eedc"}
Jul 13 17:11:56.600934 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:11:56.600877    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-746dfd5849-jjv9b" podStartSLOduration=1.774260953 podStartE2EDuration="4.600860414s" totalImagesPullingTime="2.826599461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:56.599992221 +0000 UTC m=+386.358592055" watchObservedRunningTime="2026-07-13 17:11:56.600860414 +0000 UTC m=+386.359460255"
Jul 13 17:12:05.577139 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:12:05.577108    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f6649c567-k4ffv"
Jul 13 17:13:49.551481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.551445    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"]
Jul 13 17:13:49.553725 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.553708    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.558443 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.558413    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 17:13:49.558673 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.558650    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 17:13:49.558808 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.558545    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 17:13:49.559004 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.558984    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hzghr\""
Jul 13 17:13:49.559298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.559281    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 17:13:49.566570 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.566546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"]
Jul 13 17:13:49.597735 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.597699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.597881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.597749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.597881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.597806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g276r\" (UniqueName: \"kubernetes.io/projected/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-kube-api-access-g276r\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.698694 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.698654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g276r\" (UniqueName: \"kubernetes.io/projected/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-kube-api-access-g276r\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.698858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.698758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.698858 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.698801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.698931 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:13:49.698909    2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 13 17:13:49.698977 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:13:49.698968    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert podName:5f0f5345-99d3-48d1-81aa-b27fec00bcfd nodeName:}" failed. No retries permitted until 2026-07-13 17:13:50.198951514 +0000 UTC m=+499.957551324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4m72d" (UID: "5f0f5345-99d3-48d1-81aa-b27fec00bcfd") : secret "plugin-serving-cert" not found
Jul 13 17:13:49.699415 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.699396    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:49.708907 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:49.708875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g276r\" (UniqueName: \"kubernetes.io/projected/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-kube-api-access-g276r\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:50.204372 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:50.204331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:50.206724 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:50.206699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0f5345-99d3-48d1-81aa-b27fec00bcfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4m72d\" (UID: \"5f0f5345-99d3-48d1-81aa-b27fec00bcfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:50.467614 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:50.467520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"
Jul 13 17:13:50.597631 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:50.597602    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d"]
Jul 13 17:13:50.600067 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:13:50.600041    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f0f5345_99d3_48d1_81aa_b27fec00bcfd.slice/crio-6065936e690883271fb9a67e3a6b16e92631c208f2e5af26b188a2edff0a6a12 WatchSource:0}: Error finding container 6065936e690883271fb9a67e3a6b16e92631c208f2e5af26b188a2edff0a6a12: Status 404 returned error can't find the container with id 6065936e690883271fb9a67e3a6b16e92631c208f2e5af26b188a2edff0a6a12
Jul 13 17:13:51.065599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:51.065563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d" event={"ID":"5f0f5345-99d3-48d1-81aa-b27fec00bcfd","Type":"ContainerStarted","Data":"6065936e690883271fb9a67e3a6b16e92631c208f2e5af26b188a2edff0a6a12"}
Jul 13 17:13:59.107118 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.107081    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"]
Jul 13 17:13:59.109291 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.109274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.112717 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.112693    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kbjnm\""
Jul 13 17:13:59.125762 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.125734    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"]
Jul 13 17:13:59.190409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.190367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ms4\" (UniqueName: \"kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.190590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.190424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.291644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.291602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ms4\" (UniqueName: \"kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.291841 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.291669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.292150 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.292126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.301604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.301571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ms4\" (UniqueName: \"kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.420248 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.420161    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:13:59.575243 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.575139    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"]
Jul 13 17:13:59.578609 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:13:59.578576    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f6e2a3_4837_4d32_b4db_faa2b74ac566.slice/crio-57c8ae294fc7214029059f4442ae4dbefaa60c1ce3d5d306a1875c9bf223d44f WatchSource:0}: Error finding container 57c8ae294fc7214029059f4442ae4dbefaa60c1ce3d5d306a1875c9bf223d44f: Status 404 returned error can't find the container with id 57c8ae294fc7214029059f4442ae4dbefaa60c1ce3d5d306a1875c9bf223d44f
Jul 13 17:13:59.818574 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.818501    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"]
Jul 13 17:13:59.821104 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.821073    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"]
Jul 13 17:13:59.853208 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.853169    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:13:59.856548 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.856526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:13:59.874446 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.874416    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:13:59.997726 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.997681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:13:59.997889 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:13:59.997803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swbfb\" (UniqueName: \"kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.099067 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.098970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.099229 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.099074    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swbfb\" (UniqueName: \"kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.099418 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.099397    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.114943 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.114790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swbfb\" (UniqueName: \"kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l67rd\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.171089 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.171004    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:00.488216 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:00.488094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:14:00.553839 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:14:00.553797    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f225dc_ced2_48f2_a9e4_73abe88f5a3d.slice/crio-c11333b8a5216b9004ac48c883c94b8250c999d9aa42b1957c9ce85a98b13e08 WatchSource:0}: Error finding container c11333b8a5216b9004ac48c883c94b8250c999d9aa42b1957c9ce85a98b13e08: Status 404 returned error can't find the container with id c11333b8a5216b9004ac48c883c94b8250c999d9aa42b1957c9ce85a98b13e08
Jul 13 17:14:01.123330 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:01.123288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" event={"ID":"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d","Type":"ContainerStarted","Data":"c11333b8a5216b9004ac48c883c94b8250c999d9aa42b1957c9ce85a98b13e08"}
Jul 13 17:14:19.218262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.218217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" event={"ID":"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d","Type":"ContainerStarted","Data":"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"}
Jul 13 17:14:19.218706 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.218335    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:19.219848 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.219821    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" containerName="manager" containerID="cri-o://49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984" gracePeriod=2
Jul 13 17:14:19.221396 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.221372    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d" event={"ID":"5f0f5345-99d3-48d1-81aa-b27fec00bcfd","Type":"ContainerStarted","Data":"3dc188010bb1a4c3218526eee596ae6fe61bab9985c8ef2bbcaa3eca7c231935"}
Jul 13 17:14:19.236339 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:19.236312    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:19.237295 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.237254    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" podStartSLOduration=2.647010371 podStartE2EDuration="20.237238993s" totalImagesPullingTime="17.590228622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:14:19.234077877 +0000 UTC m=+528.992677709" watchObservedRunningTime="2026-07-13 17:14:19.237238993 +0000 UTC m=+528.995838825"
Jul 13 17:14:19.253235 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.252633    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4m72d" podStartSLOduration=2.69409704 podStartE2EDuration="30.25261519s" totalImagesPullingTime="27.55851815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:14:19.250539112 +0000 UTC m=+529.009138944" watchObservedRunningTime="2026-07-13 17:14:19.25261519 +0000 UTC m=+529.011215024"
Jul 13 17:14:19.451649 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.451623    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:19.453703 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:19.453675    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:19.478753 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.478680    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9ms4\" (UniqueName: \"kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4\") pod \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") "
Jul 13 17:14:19.478881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.478780    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume\") pod \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\" (UID: \"c5f6e2a3-4837-4d32-b4db-faa2b74ac566\") "
Jul 13 17:14:19.479053 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.479006    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c5f6e2a3-4837-4d32-b4db-faa2b74ac566" (UID: "c5f6e2a3-4837-4d32-b4db-faa2b74ac566"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:19.480776 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.480746    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4" (OuterVolumeSpecName: "kube-api-access-p9ms4") pod "c5f6e2a3-4837-4d32-b4db-faa2b74ac566" (UID: "c5f6e2a3-4837-4d32-b4db-faa2b74ac566"). InnerVolumeSpecName "kube-api-access-p9ms4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:14:19.580048 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.579999    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-extensions-socket-volume\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:14:19.580048 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:19.580044    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9ms4\" (UniqueName: \"kubernetes.io/projected/c5f6e2a3-4837-4d32-b4db-faa2b74ac566-kube-api-access-p9ms4\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:14:20.227358 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.227321    2567 generic.go:356] "Generic (PLEG): container finished" podID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" containerID="49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984" exitCode=2
Jul 13 17:14:20.227835 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.227373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:20.227835 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.227414    2567 scope.go:117] "RemoveContainer" containerID="49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984"
Jul 13 17:14:20.233901 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:20.233849    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:20.240930 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:20.240902    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:20.242471 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.242449    2567 scope.go:117] "RemoveContainer" containerID="49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984"
Jul 13 17:14:20.242727 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:20.242705    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984\": container with ID starting with 49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984 not found: ID does not exist" containerID="49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984"
Jul 13 17:14:20.242804 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.242733    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984"} err="failed to get container status \"49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984\": rpc error: code = NotFound desc = could not find container \"49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984\": container with ID starting with 49e0f63c1ab083dc1d8af5a93e6021c33d19620acee00f6da4b2f021d80dd984 not found: ID does not exist"
Jul 13 17:14:20.893039 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:20.892979    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jbf86\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jbf86"
Jul 13 17:14:20.894816 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:20.894790    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" path="/var/lib/kubelet/pods/c5f6e2a3-4837-4d32-b4db-faa2b74ac566/volumes"
Jul 13 17:14:30.230830 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:30.230797    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:42.423037 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:42.422987    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:14:42.423435 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:42.423238    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" podUID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" containerName="manager" containerID="cri-o://deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050" gracePeriod=10
Jul 13 17:14:43.217908 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.217881    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:43.292296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.292267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swbfb\" (UniqueName: \"kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb\") pod \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") "
Jul 13 17:14:43.292467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.292322    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume\") pod \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\" (UID: \"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d\") "
Jul 13 17:14:43.292804 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.292755    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" (UID: "f0f225dc-ced2-48f2-a9e4-73abe88f5a3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:43.294459 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.294429    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb" (OuterVolumeSpecName: "kube-api-access-swbfb") pod "f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" (UID: "f0f225dc-ced2-48f2-a9e4-73abe88f5a3d"). InnerVolumeSpecName "kube-api-access-swbfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:14:43.338754 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.338685    2567 generic.go:356] "Generic (PLEG): container finished" podID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" containerID="deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050" exitCode=0
Jul 13 17:14:43.338754 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.338727    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"
Jul 13 17:14:43.338929 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.338763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" event={"ID":"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d","Type":"ContainerDied","Data":"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"}
Jul 13 17:14:43.338929 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.338834    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd" event={"ID":"f0f225dc-ced2-48f2-a9e4-73abe88f5a3d","Type":"ContainerDied","Data":"c11333b8a5216b9004ac48c883c94b8250c999d9aa42b1957c9ce85a98b13e08"}
Jul 13 17:14:43.338929 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.338857    2567 scope.go:117] "RemoveContainer" containerID="deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"
Jul 13 17:14:43.347986 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.347969    2567 scope.go:117] "RemoveContainer" containerID="deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"
Jul 13 17:14:43.348284 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:43.348266    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050\": container with ID starting with deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050 not found: ID does not exist" containerID="deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"
Jul 13 17:14:43.348332 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.348292    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050"} err="failed to get container status \"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050\": rpc error: code = NotFound desc = could not find container \"deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050\": container with ID starting with deddab805beccb021947746058349e80e9fab783244fbf20a69df00fb8226050 not found: ID does not exist"
Jul 13 17:14:43.362680 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.362656    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:14:43.366652 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.366630    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l67rd"]
Jul 13 17:14:43.393281 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.393252    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swbfb\" (UniqueName: \"kubernetes.io/projected/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-kube-api-access-swbfb\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:14:43.393281 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:43.393280    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d-extensions-socket-volume\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:14:44.895989 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:44.895955    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" path="/var/lib/kubelet/pods/f0f225dc-ced2-48f2-a9e4-73abe88f5a3d/volumes"
Jul 13 17:14:49.312384 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312348    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312717    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" containerName="manager"
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312732    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" containerName="manager"
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312744    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" containerName="manager"
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312750    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" containerName="manager"
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312802    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f6e2a3-4837-4d32-b4db-faa2b74ac566" containerName="manager"
Jul 13 17:14:49.312853 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.312810    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f225dc-ced2-48f2-a9e4-73abe88f5a3d" containerName="manager"
Jul 13 17:14:49.693233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.693193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:14:49.693233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.693234    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:14:49.693432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.693321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.696126 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.696099    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 17:14:49.855549 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.855506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.855724 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.855561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vns\" (UniqueName: \"kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.957193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.957106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.957193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.957146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vns\" (UniqueName: \"kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.957785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.957761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:49.964979 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:49.964957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vns\" (UniqueName: \"kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns\") pod \"limitador-limitador-64c94fd64f-26kjm\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:50.004005 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.003967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:50.131473 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.131439    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:50.155966 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:14:50.155938    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4e218d_dbfb_4726_9ed2_da9f00346659.slice/crio-29d671046d7b69c6d7b14fd2a9830041a43827def42d4aea896ea48f3bc1dacf WatchSource:0}: Error finding container 29d671046d7b69c6d7b14fd2a9830041a43827def42d4aea896ea48f3bc1dacf: Status 404 returned error can't find the container with id 29d671046d7b69c6d7b14fd2a9830041a43827def42d4aea896ea48f3bc1dacf
Jul 13 17:14:50.168688 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.168660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:50.168688 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.168693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:14:50.168812 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.168783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:50.170828 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.170810    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nzjcf\""
Jul 13 17:14:50.261142 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.261049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5nnk\" (UniqueName: \"kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk\") pod \"authorino-58cd955675-xxkxn\" (UID: \"a80e7ef5-6355-4527-aeae-16167681a8ba\") " pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:50.306261 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.306225    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:14:50.327932 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.327905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:14:50.328387 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.328028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:14:50.361941 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.361910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5nnk\" (UniqueName: \"kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk\") pod \"authorino-58cd955675-xxkxn\" (UID: \"a80e7ef5-6355-4527-aeae-16167681a8ba\") " pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:50.370216 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.370184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5nnk\" (UniqueName: \"kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk\") pod \"authorino-58cd955675-xxkxn\" (UID: \"a80e7ef5-6355-4527-aeae-16167681a8ba\") " pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:50.372625 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.372585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" event={"ID":"ce4e218d-dbfb-4726-9ed2-da9f00346659","Type":"ContainerStarted","Data":"29d671046d7b69c6d7b14fd2a9830041a43827def42d4aea896ea48f3bc1dacf"}
Jul 13 17:14:50.462553 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.462518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs5zj\" (UniqueName: \"kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj\") pod \"authorino-75d556bd77-vg5z8\" (UID: \"3c2b690d-c570-4b92-a25d-e98d1b0b598b\") " pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:14:50.478407 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.478378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:50.563842 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.563810    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs5zj\" (UniqueName: \"kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj\") pod \"authorino-75d556bd77-vg5z8\" (UID: \"3c2b690d-c570-4b92-a25d-e98d1b0b598b\") " pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:14:50.571824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.571795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs5zj\" (UniqueName: \"kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj\") pod \"authorino-75d556bd77-vg5z8\" (UID: \"3c2b690d-c570-4b92-a25d-e98d1b0b598b\") " pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:14:50.619475 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.619450    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:50.621877 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:14:50.621856    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda80e7ef5_6355_4527_aeae_16167681a8ba.slice/crio-8dfaa7ab7031c8596809e0073109746308511e1c47d31aa2c9edbd43ba9f2013 WatchSource:0}: Error finding container 8dfaa7ab7031c8596809e0073109746308511e1c47d31aa2c9edbd43ba9f2013: Status 404 returned error can't find the container with id 8dfaa7ab7031c8596809e0073109746308511e1c47d31aa2c9edbd43ba9f2013
Jul 13 17:14:50.637125 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.637099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:14:50.768722 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:50.768693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:14:50.771273 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:14:50.771241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c2b690d_c570_4b92_a25d_e98d1b0b598b.slice/crio-25cc8efb6cdb20d1e84403179b36cb97cd9b0347d7676d9bbacaee6649145b95 WatchSource:0}: Error finding container 25cc8efb6cdb20d1e84403179b36cb97cd9b0347d7676d9bbacaee6649145b95: Status 404 returned error can't find the container with id 25cc8efb6cdb20d1e84403179b36cb97cd9b0347d7676d9bbacaee6649145b95
Jul 13 17:14:51.381946 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:51.381863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxkxn" event={"ID":"a80e7ef5-6355-4527-aeae-16167681a8ba","Type":"ContainerStarted","Data":"8dfaa7ab7031c8596809e0073109746308511e1c47d31aa2c9edbd43ba9f2013"}
Jul 13 17:14:51.387156 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:51.387095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vg5z8" event={"ID":"3c2b690d-c570-4b92-a25d-e98d1b0b598b","Type":"ContainerStarted","Data":"25cc8efb6cdb20d1e84403179b36cb97cd9b0347d7676d9bbacaee6649145b95"}
Jul 13 17:14:55.421219 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.421181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" event={"ID":"ce4e218d-dbfb-4726-9ed2-da9f00346659","Type":"ContainerStarted","Data":"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"}
Jul 13 17:14:55.421698 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.421293    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:14:55.422786 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.422751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vg5z8" event={"ID":"3c2b690d-c570-4b92-a25d-e98d1b0b598b","Type":"ContainerStarted","Data":"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"}
Jul 13 17:14:55.424005 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.423982    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxkxn" event={"ID":"a80e7ef5-6355-4527-aeae-16167681a8ba","Type":"ContainerStarted","Data":"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"}
Jul 13 17:14:55.437264 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.437176    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" podStartSLOduration=1.4084485230000001 podStartE2EDuration="6.437161415s" totalImagesPullingTime="5.028712892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:14:55.435773322 +0000 UTC m=+565.194373166" watchObservedRunningTime="2026-07-13 17:14:55.437161415 +0000 UTC m=+565.195761295"
Jul 13 17:14:55.449892 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.449848    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xxkxn" podStartSLOduration=0.875747359 podStartE2EDuration="5.449834252s" totalImagesPullingTime="4.574086893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:14:55.448830739 +0000 UTC m=+565.207430572" watchObservedRunningTime="2026-07-13 17:14:55.449834252 +0000 UTC m=+565.208434084"
Jul 13 17:14:55.467600 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.467544    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vg5z8" podStartSLOduration=1.039139089 podStartE2EDuration="5.467527231s" totalImagesPullingTime="4.428388142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:14:55.465776382 +0000 UTC m=+565.224376214" watchObservedRunningTime="2026-07-13 17:14:55.467527231 +0000 UTC m=+565.226127064"
Jul 13 17:14:55.492834 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:55.492797    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:57.433708 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:57.433664    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xxkxn" podUID="a80e7ef5-6355-4527-aeae-16167681a8ba" containerName="authorino" containerID="cri-o://306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b" gracePeriod=30
Jul 13 17:14:57.670211 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:57.670186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:57.836072 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:57.835955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5nnk\" (UniqueName: \"kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk\") pod \"a80e7ef5-6355-4527-aeae-16167681a8ba\" (UID: \"a80e7ef5-6355-4527-aeae-16167681a8ba\") "
Jul 13 17:14:57.838144 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:57.838105    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk" (OuterVolumeSpecName: "kube-api-access-m5nnk") pod "a80e7ef5-6355-4527-aeae-16167681a8ba" (UID: "a80e7ef5-6355-4527-aeae-16167681a8ba"). InnerVolumeSpecName "kube-api-access-m5nnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:14:57.936855 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:57.936814    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5nnk\" (UniqueName: \"kubernetes.io/projected/a80e7ef5-6355-4527-aeae-16167681a8ba-kube-api-access-m5nnk\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:14:58.439578 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.439542    2567 generic.go:356] "Generic (PLEG): container finished" podID="a80e7ef5-6355-4527-aeae-16167681a8ba" containerID="306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b" exitCode=0
Jul 13 17:14:58.440057 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.439594    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxkxn"
Jul 13 17:14:58.440057 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.439613    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxkxn" event={"ID":"a80e7ef5-6355-4527-aeae-16167681a8ba","Type":"ContainerDied","Data":"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"}
Jul 13 17:14:58.440057 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.439645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxkxn" event={"ID":"a80e7ef5-6355-4527-aeae-16167681a8ba","Type":"ContainerDied","Data":"8dfaa7ab7031c8596809e0073109746308511e1c47d31aa2c9edbd43ba9f2013"}
Jul 13 17:14:58.440057 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.439661    2567 scope.go:117] "RemoveContainer" containerID="306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"
Jul 13 17:14:58.448936 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.448919    2567 scope.go:117] "RemoveContainer" containerID="306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"
Jul 13 17:14:58.449236 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:14:58.449220    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b\": container with ID starting with 306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b not found: ID does not exist" containerID="306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"
Jul 13 17:14:58.449305 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.449243    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b"} err="failed to get container status \"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b\": rpc error: code = NotFound desc = could not find container \"306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b\": container with ID starting with 306c0e59529ec3fe305b2c8904921ec5dd2084ef0402f8b45e5aeb67860bba8b not found: ID does not exist"
Jul 13 17:14:58.459825 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.459801    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:58.468370 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.466384    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxkxn"]
Jul 13 17:14:58.896111 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:14:58.895997    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80e7ef5-6355-4527-aeae-16167681a8ba" path="/var/lib/kubelet/pods/a80e7ef5-6355-4527-aeae-16167681a8ba/volumes"
Jul 13 17:15:04.531587 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:04.531552    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:15:04.532164 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:04.531736    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" podUID="ce4e218d-dbfb-4726-9ed2-da9f00346659" containerName="limitador" containerID="cri-o://697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc" gracePeriod=30
Jul 13 17:15:04.532580 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:04.532404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:15:05.103605 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.103548    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:15:05.198373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.198337    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file\") pod \"ce4e218d-dbfb-4726-9ed2-da9f00346659\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") "
Jul 13 17:15:05.198537 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.198398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vns\" (UniqueName: \"kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns\") pod \"ce4e218d-dbfb-4726-9ed2-da9f00346659\" (UID: \"ce4e218d-dbfb-4726-9ed2-da9f00346659\") "
Jul 13 17:15:05.198695 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.198673    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file" (OuterVolumeSpecName: "config-file") pod "ce4e218d-dbfb-4726-9ed2-da9f00346659" (UID: "ce4e218d-dbfb-4726-9ed2-da9f00346659"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:15:05.200462 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.200442    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns" (OuterVolumeSpecName: "kube-api-access-49vns") pod "ce4e218d-dbfb-4726-9ed2-da9f00346659" (UID: "ce4e218d-dbfb-4726-9ed2-da9f00346659"). InnerVolumeSpecName "kube-api-access-49vns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:15:05.299634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.299598    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vns\" (UniqueName: \"kubernetes.io/projected/ce4e218d-dbfb-4726-9ed2-da9f00346659-kube-api-access-49vns\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:05.299634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.299628    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce4e218d-dbfb-4726-9ed2-da9f00346659-config-file\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:05.472213 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.472178    2567 generic.go:356] "Generic (PLEG): container finished" podID="ce4e218d-dbfb-4726-9ed2-da9f00346659" containerID="697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc" exitCode=0
Jul 13 17:15:05.472409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.472224    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm"
Jul 13 17:15:05.472409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.472236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" event={"ID":"ce4e218d-dbfb-4726-9ed2-da9f00346659","Type":"ContainerDied","Data":"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"}
Jul 13 17:15:05.472409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.472289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26kjm" event={"ID":"ce4e218d-dbfb-4726-9ed2-da9f00346659","Type":"ContainerDied","Data":"29d671046d7b69c6d7b14fd2a9830041a43827def42d4aea896ea48f3bc1dacf"}
Jul 13 17:15:05.472409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.472316    2567 scope.go:117] "RemoveContainer" containerID="697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"
Jul 13 17:15:05.481038 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.481000    2567 scope.go:117] "RemoveContainer" containerID="697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"
Jul 13 17:15:05.481318 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:15:05.481299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc\": container with ID starting with 697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc not found: ID does not exist" containerID="697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"
Jul 13 17:15:05.481365 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.481328    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc"} err="failed to get container status \"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc\": rpc error: code = NotFound desc = could not find container \"697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc\": container with ID starting with 697a017e50c2748a55df61dd514dfb51a1ea908af04de6bdf09e8dbab7e281dc not found: ID does not exist"
Jul 13 17:15:05.492028 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.491988    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:15:05.495550 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:05.495525    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26kjm"]
Jul 13 17:15:06.894548 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:06.894504    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce4e218d-dbfb-4726-9ed2-da9f00346659" path="/var/lib/kubelet/pods/ce4e218d-dbfb-4726-9ed2-da9f00346659/volumes"
Jul 13 17:15:10.361061 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361029    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"]
Jul 13 17:15:10.361547 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361531    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce4e218d-dbfb-4726-9ed2-da9f00346659" containerName="limitador"
Jul 13 17:15:10.361598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361551    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce4e218d-dbfb-4726-9ed2-da9f00346659" containerName="limitador"
Jul 13 17:15:10.361598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361573    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80e7ef5-6355-4527-aeae-16167681a8ba" containerName="authorino"
Jul 13 17:15:10.361598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361582    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80e7ef5-6355-4527-aeae-16167681a8ba" containerName="authorino"
Jul 13 17:15:10.361690 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361664    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce4e218d-dbfb-4726-9ed2-da9f00346659" containerName="limitador"
Jul 13 17:15:10.361690 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.361675    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80e7ef5-6355-4527-aeae-16167681a8ba" containerName="authorino"
Jul 13 17:15:10.364691 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.364660    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.366753 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.366729    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 17:15:10.366860 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.366813    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 17:15:10.367146 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.367129    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 17:15:10.367232 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.367152    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-98r26\""
Jul 13 17:15:10.376955 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.376931    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"]
Jul 13 17:15:10.445393 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.445358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxjx\" (UniqueName: \"kubernetes.io/projected/52393e83-64bb-4b25-a0ee-c90491944bc1-kube-api-access-xzxjx\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.445561 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.445428    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/52393e83-64bb-4b25-a0ee-c90491944bc1-data\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.545977 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.545936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/52393e83-64bb-4b25-a0ee-c90491944bc1-data\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.546171 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.546034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxjx\" (UniqueName: \"kubernetes.io/projected/52393e83-64bb-4b25-a0ee-c90491944bc1-kube-api-access-xzxjx\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.546339 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.546316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/52393e83-64bb-4b25-a0ee-c90491944bc1-data\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.564897 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.564867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxjx\" (UniqueName: \"kubernetes.io/projected/52393e83-64bb-4b25-a0ee-c90491944bc1-kube-api-access-xzxjx\") pod \"postgres-69fb4594cf-kcw9w\" (UID: \"52393e83-64bb-4b25-a0ee-c90491944bc1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.675596 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.675566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:10.802644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:10.802611    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"]
Jul 13 17:15:10.805119 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:15:10.805077    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52393e83_64bb_4b25_a0ee_c90491944bc1.slice/crio-f2abb036cf2aae77d459ece8a9649d4553df6d73b3be05a95bd9fe345f5985ff WatchSource:0}: Error finding container f2abb036cf2aae77d459ece8a9649d4553df6d73b3be05a95bd9fe345f5985ff: Status 404 returned error can't find the container with id f2abb036cf2aae77d459ece8a9649d4553df6d73b3be05a95bd9fe345f5985ff
Jul 13 17:15:11.505092 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:11.505048    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w" event={"ID":"52393e83-64bb-4b25-a0ee-c90491944bc1","Type":"ContainerStarted","Data":"f2abb036cf2aae77d459ece8a9649d4553df6d73b3be05a95bd9fe345f5985ff"}
Jul 13 17:15:16.537395 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:16.537358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w" event={"ID":"52393e83-64bb-4b25-a0ee-c90491944bc1","Type":"ContainerStarted","Data":"dc306d0f92695345ddd336abd42e7252e8ae7a5e2c5470c4e0d0722abe430443"}
Jul 13 17:15:16.537830 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:16.537448    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:16.552806 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:16.552757    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w" podStartSLOduration=1.8632864 podStartE2EDuration="6.552744199s" totalImagesPullingTime="4.689457799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:15:16.551455151 +0000 UTC m=+586.310054997" watchObservedRunningTime="2026-07-13 17:15:16.552744199 +0000 UTC m=+586.311344040"
Jul 13 17:15:22.572675 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:22.572643    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcw9w"
Jul 13 17:15:23.163797 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.163764    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nwzzr"]
Jul 13 17:15:23.169633 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.169611    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.173865 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.173840    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nwzzr"]
Jul 13 17:15:23.268831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.268791    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p8w\" (UniqueName: \"kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w\") pod \"authorino-5d4b67c446-nwzzr\" (UID: \"e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60\") " pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.332359 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.332320    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nwzzr"]
Jul 13 17:15:23.332653 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:15:23.332629    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q2p8w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nwzzr" podUID="e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60"
Jul 13 17:15:23.360951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.360919    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-qjbbq"]
Jul 13 17:15:23.364653 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.364629    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.366561 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.366545    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 17:15:23.369494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.369466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p8w\" (UniqueName: \"kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w\") pod \"authorino-5d4b67c446-nwzzr\" (UID: \"e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60\") " pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.370996 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.370973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-qjbbq"]
Jul 13 17:15:23.381667 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.381640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p8w\" (UniqueName: \"kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w\") pod \"authorino-5d4b67c446-nwzzr\" (UID: \"e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60\") " pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.423673 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.423595    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qjbbq"]
Jul 13 17:15:23.423875 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:15:23.423856    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5wfkk tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-5wfkk tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-qjbbq" podUID="0746c400-57e5-4758-bcea-bd93c59d9244"
Jul 13 17:15:23.450287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.450256    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:15:23.454122 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.454103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.464663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.464641    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:15:23.470291 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.470268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfkk\" (UniqueName: \"kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.470392 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.470374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.569582 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.569549    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.569779 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.569560    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.570782 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.570758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.570899 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.570787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.570899 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.570808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfkk\" (UniqueName: \"kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.570899 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.570835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48fqj\" (UniqueName: \"kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.573256 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.573232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.576926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.576906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.577744 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.577722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfkk\" (UniqueName: \"kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk\") pod \"authorino-76877994-qjbbq\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") " pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:23.595102 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.595076    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:23.671939 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.671908    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wfkk\" (UniqueName: \"kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk\") pod \"0746c400-57e5-4758-bcea-bd93c59d9244\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") "
Jul 13 17:15:23.672144 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.671963    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2p8w\" (UniqueName: \"kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w\") pod \"e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60\" (UID: \"e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60\") "
Jul 13 17:15:23.672144 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.671987    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert\") pod \"0746c400-57e5-4758-bcea-bd93c59d9244\" (UID: \"0746c400-57e5-4758-bcea-bd93c59d9244\") "
Jul 13 17:15:23.672268 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.672166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.672268 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.672193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48fqj\" (UniqueName: \"kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.674218 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.674151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0746c400-57e5-4758-bcea-bd93c59d9244" (UID: "0746c400-57e5-4758-bcea-bd93c59d9244"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:15:23.674324 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.674256    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w" (OuterVolumeSpecName: "kube-api-access-q2p8w") pod "e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60" (UID: "e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60"). InnerVolumeSpecName "kube-api-access-q2p8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:15:23.674324 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.674267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk" (OuterVolumeSpecName: "kube-api-access-5wfkk") pod "0746c400-57e5-4758-bcea-bd93c59d9244" (UID: "0746c400-57e5-4758-bcea-bd93c59d9244"). InnerVolumeSpecName "kube-api-access-5wfkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:15:23.674710 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.674686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.679762 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.679743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48fqj\" (UniqueName: \"kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj\") pod \"authorino-7d8fc99f97-ns2wq\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") " pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.763262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.763217    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:15:23.772668 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.772638    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2p8w\" (UniqueName: \"kubernetes.io/projected/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60-kube-api-access-q2p8w\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:23.772668 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.772663    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0746c400-57e5-4758-bcea-bd93c59d9244-tls-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:23.772835 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.772678    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wfkk\" (UniqueName: \"kubernetes.io/projected/0746c400-57e5-4758-bcea-bd93c59d9244-kube-api-access-5wfkk\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:23.898138 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:23.898110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:15:23.900351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:15:23.900320    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c73586b_3e3d_4481_9eb8_3d84609aae55.slice/crio-97e8b2f1c06621c3a0ec8dc36d7fabb1224b7b5e90633ad931b235f4e2830639 WatchSource:0}: Error finding container 97e8b2f1c06621c3a0ec8dc36d7fabb1224b7b5e90633ad931b235f4e2830639: Status 404 returned error can't find the container with id 97e8b2f1c06621c3a0ec8dc36d7fabb1224b7b5e90633ad931b235f4e2830639
Jul 13 17:15:24.575584 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.575485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" event={"ID":"6c73586b-3e3d-4481-9eb8-3d84609aae55","Type":"ContainerStarted","Data":"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"}
Jul 13 17:15:24.575584 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.575528    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qjbbq"
Jul 13 17:15:24.575584 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.575533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" event={"ID":"6c73586b-3e3d-4481-9eb8-3d84609aae55","Type":"ContainerStarted","Data":"97e8b2f1c06621c3a0ec8dc36d7fabb1224b7b5e90633ad931b235f4e2830639"}
Jul 13 17:15:24.575584 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.575505    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nwzzr"
Jul 13 17:15:24.593768 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.593723    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" podStartSLOduration=1.21063937 podStartE2EDuration="1.593706859s" totalImagesPullingTime="383.067489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:15:24.592273034 +0000 UTC m=+594.350872868" watchObservedRunningTime="2026-07-13 17:15:24.593706859 +0000 UTC m=+594.352306690"
Jul 13 17:15:24.618190 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.618162    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nwzzr"]
Jul 13 17:15:24.624716 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.624678    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:15:24.625534 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.624897    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vg5z8" podUID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" containerName="authorino" containerID="cri-o://08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b" gracePeriod=30
Jul 13 17:15:24.626807 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.626783    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nwzzr"]
Jul 13 17:15:24.651727 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.651699    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qjbbq"]
Jul 13 17:15:24.655971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.655947    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-qjbbq"]
Jul 13 17:15:24.869976 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.869953    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:15:24.901905 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.901870    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0746c400-57e5-4758-bcea-bd93c59d9244" path="/var/lib/kubelet/pods/0746c400-57e5-4758-bcea-bd93c59d9244/volumes"
Jul 13 17:15:24.902172 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.902156    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60" path="/var/lib/kubelet/pods/e1cd7e58-a9ea-464c-ab2e-e5d45bb5bd60/volumes"
Jul 13 17:15:24.983920 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.983882    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs5zj\" (UniqueName: \"kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj\") pod \"3c2b690d-c570-4b92-a25d-e98d1b0b598b\" (UID: \"3c2b690d-c570-4b92-a25d-e98d1b0b598b\") "
Jul 13 17:15:24.985924 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:24.985894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj" (OuterVolumeSpecName: "kube-api-access-rs5zj") pod "3c2b690d-c570-4b92-a25d-e98d1b0b598b" (UID: "3c2b690d-c570-4b92-a25d-e98d1b0b598b"). InnerVolumeSpecName "kube-api-access-rs5zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:15:25.085066 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.085006    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs5zj\" (UniqueName: \"kubernetes.io/projected/3c2b690d-c570-4b92-a25d-e98d1b0b598b-kube-api-access-rs5zj\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:15:25.581006 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.580964    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" containerID="08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b" exitCode=0
Jul 13 17:15:25.581482 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.581046    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vg5z8"
Jul 13 17:15:25.581482 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.581051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vg5z8" event={"ID":"3c2b690d-c570-4b92-a25d-e98d1b0b598b","Type":"ContainerDied","Data":"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"}
Jul 13 17:15:25.581482 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.581097    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vg5z8" event={"ID":"3c2b690d-c570-4b92-a25d-e98d1b0b598b","Type":"ContainerDied","Data":"25cc8efb6cdb20d1e84403179b36cb97cd9b0347d7676d9bbacaee6649145b95"}
Jul 13 17:15:25.581482 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.581114    2567 scope.go:117] "RemoveContainer" containerID="08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"
Jul 13 17:15:25.589567 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.589550    2567 scope.go:117] "RemoveContainer" containerID="08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"
Jul 13 17:15:25.589812 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:15:25.589794    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b\": container with ID starting with 08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b not found: ID does not exist" containerID="08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"
Jul 13 17:15:25.589852 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.589820    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b"} err="failed to get container status \"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b\": rpc error: code = NotFound desc = could not find container \"08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b\": container with ID starting with 08682b66c9ce96b5cff86f27b9e045d58870d118490f7ad91394c4b1065c014b not found: ID does not exist"
Jul 13 17:15:25.603004 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.602975    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:15:25.605562 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:25.605530    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vg5z8"]
Jul 13 17:15:26.895182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:26.895151    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" path="/var/lib/kubelet/pods/3c2b690d-c570-4b92-a25d-e98d1b0b598b/volumes"
Jul 13 17:15:30.775373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:30.775337    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:15:30.778978 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:15:30.778951    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:16:06.597301 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.597220    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5874c489-tscjh"]
Jul 13 17:16:06.597749 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.597572    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" containerName="authorino"
Jul 13 17:16:06.597749 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.597583    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" containerName="authorino"
Jul 13 17:16:06.597749 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.597662    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2b690d-c570-4b92-a25d-e98d1b0b598b" containerName="authorino"
Jul 13 17:16:06.599798 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.599780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.602423 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.602397    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6n9qp\""
Jul 13 17:16:06.602611 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.602589    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 17:16:06.615237 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.615210    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5874c489-tscjh"]
Jul 13 17:16:06.652180 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.652135    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e5f489-ea40-491f-8f5c-7338db374396-maas-api-tls\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.652363 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.652221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkgff\" (UniqueName: \"kubernetes.io/projected/80e5f489-ea40-491f-8f5c-7338db374396-kube-api-access-bkgff\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.652363 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.652243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e5f489-ea40-491f-8f5c-7338db374396-openshift-service-ca\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.753416 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.753380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkgff\" (UniqueName: \"kubernetes.io/projected/80e5f489-ea40-491f-8f5c-7338db374396-kube-api-access-bkgff\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.753416 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.753422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e5f489-ea40-491f-8f5c-7338db374396-openshift-service-ca\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.753671 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.753477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e5f489-ea40-491f-8f5c-7338db374396-maas-api-tls\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.754287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.754267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e5f489-ea40-491f-8f5c-7338db374396-openshift-service-ca\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.755967 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.755941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e5f489-ea40-491f-8f5c-7338db374396-maas-api-tls\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.766953 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.766925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkgff\" (UniqueName: \"kubernetes.io/projected/80e5f489-ea40-491f-8f5c-7338db374396-kube-api-access-bkgff\") pod \"maas-api-5874c489-tscjh\" (UID: \"80e5f489-ea40-491f-8f5c-7338db374396\") " pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:06.910409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:06.910321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:07.046327 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.046135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5874c489-tscjh"]
Jul 13 17:16:07.048674 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:16:07.048639    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e5f489_ea40_491f_8f5c_7338db374396.slice/crio-6f19a7de0e646199e6616280a303db09fae71417370fe2a78178c4045fccfaa0 WatchSource:0}: Error finding container 6f19a7de0e646199e6616280a303db09fae71417370fe2a78178c4045fccfaa0: Status 404 returned error can't find the container with id 6f19a7de0e646199e6616280a303db09fae71417370fe2a78178c4045fccfaa0
Jul 13 17:16:07.406681 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.406642    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-24nct"]
Jul 13 17:16:07.409679 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.409656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.412364 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.412343    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-27s9c\""
Jul 13 17:16:07.412694 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.412670    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 17:16:07.424911 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.424887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-24nct"]
Jul 13 17:16:07.460284 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.460244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b15f2c-bdd2-43d5-9348-d15a39295e5d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.460463 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.460319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27shw\" (UniqueName: \"kubernetes.io/projected/00b15f2c-bdd2-43d5-9348-d15a39295e5d-kube-api-access-27shw\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.560965 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.560930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27shw\" (UniqueName: \"kubernetes.io/projected/00b15f2c-bdd2-43d5-9348-d15a39295e5d-kube-api-access-27shw\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.561140 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.561024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b15f2c-bdd2-43d5-9348-d15a39295e5d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.561682 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.561654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b15f2c-bdd2-43d5-9348-d15a39295e5d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.577241 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.577212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27shw\" (UniqueName: \"kubernetes.io/projected/00b15f2c-bdd2-43d5-9348-d15a39295e5d-kube-api-access-27shw\") pod \"payload-pre-processing-74584bb9f8-24nct\" (UID: \"00b15f2c-bdd2-43d5-9348-d15a39295e5d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.721563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.721511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:07.780507 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.780462    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh" event={"ID":"80e5f489-ea40-491f-8f5c-7338db374396","Type":"ContainerStarted","Data":"6f19a7de0e646199e6616280a303db09fae71417370fe2a78178c4045fccfaa0"}
Jul 13 17:16:07.879417 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:07.879384    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-24nct"]
Jul 13 17:16:07.881832 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:16:07.881800    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b15f2c_bdd2_43d5_9348_d15a39295e5d.slice/crio-b96ca8950dcc7a2af7eb856e491041303eb3fda051ea97a6509b0d072dfcdc11 WatchSource:0}: Error finding container b96ca8950dcc7a2af7eb856e491041303eb3fda051ea97a6509b0d072dfcdc11: Status 404 returned error can't find the container with id b96ca8950dcc7a2af7eb856e491041303eb3fda051ea97a6509b0d072dfcdc11
Jul 13 17:16:08.786974 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:08.786939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct" event={"ID":"00b15f2c-bdd2-43d5-9348-d15a39295e5d","Type":"ContainerStarted","Data":"b96ca8950dcc7a2af7eb856e491041303eb3fda051ea97a6509b0d072dfcdc11"}
Jul 13 17:16:08.788681 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:08.788659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh" event={"ID":"80e5f489-ea40-491f-8f5c-7338db374396","Type":"ContainerStarted","Data":"a6b51710227bece1cbab89910c3ac3964459b76c98916606698f38f464902a25"}
Jul 13 17:16:08.788817 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:08.788790    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:08.805039 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:08.804975    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh" podStartSLOduration=1.139168392 podStartE2EDuration="2.804960875s" totalImagesPullingTime="1.665792483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:16:08.803338854 +0000 UTC m=+638.561938685" watchObservedRunningTime="2026-07-13 17:16:08.804960875 +0000 UTC m=+638.563560706"
Jul 13 17:16:09.794965 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:09.794915    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct" event={"ID":"00b15f2c-bdd2-43d5-9348-d15a39295e5d","Type":"ContainerStarted","Data":"db2273706a5886aca96434a1e8b519f7bc86ede367ab3ec6793acd82e3493de2"}
Jul 13 17:16:09.795436 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:09.795059    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:09.814981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:09.814868    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct" podStartSLOduration=1.133494328 podStartE2EDuration="2.814850203s" totalImagesPullingTime="1.681355875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:16:09.812438695 +0000 UTC m=+639.571038550" watchObservedRunningTime="2026-07-13 17:16:09.814850203 +0000 UTC m=+639.573450055"
Jul 13 17:16:14.800455 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:14.800424    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5874c489-tscjh"
Jul 13 17:16:20.802914 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:20.802877    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-24nct"
Jul 13 17:16:46.525185 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.525144    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"]
Jul 13 17:16:46.530680 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.530657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.532638 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.532617    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 17:16:46.533177 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.533158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jcvk5\""
Jul 13 17:16:46.533177 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.533171    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 17:16:46.533313 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.533253    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 13 17:16:46.541503 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.541478    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"]
Jul 13 17:16:46.610876 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.610844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.611065 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.610889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2hq\" (UniqueName: \"kubernetes.io/projected/ce28563e-42f6-4748-8903-6f72b78a8bf7-kube-api-access-pf2hq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.611065 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.610959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.611065 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.611057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.611203 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.611111    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.611203 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.611128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce28563e-42f6-4748-8903-6f72b78a8bf7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.711931 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.711890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.711931 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.711935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2hq\" (UniqueName: \"kubernetes.io/projected/ce28563e-42f6-4748-8903-6f72b78a8bf7-kube-api-access-pf2hq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.711956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.711991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.712046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.712061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce28563e-42f6-4748-8903-6f72b78a8bf7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712458 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.712434    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.712489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.712575 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.712558    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.714241 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.714219    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce28563e-42f6-4748-8903-6f72b78a8bf7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.714550 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.714534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce28563e-42f6-4748-8903-6f72b78a8bf7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.719373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.719353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2hq\" (UniqueName: \"kubernetes.io/projected/ce28563e-42f6-4748-8903-6f72b78a8bf7-kube-api-access-pf2hq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s9gpf\" (UID: \"ce28563e-42f6-4748-8903-6f72b78a8bf7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.843432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.843338    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:46.974698 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.974671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"]
Jul 13 17:16:46.976558 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:16:46.976529    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce28563e_42f6_4748_8903_6f72b78a8bf7.slice/crio-90f22b2ff5c602c623a722f58a6deec0f5262db326d10af4af229bf597b88443 WatchSource:0}: Error finding container 90f22b2ff5c602c623a722f58a6deec0f5262db326d10af4af229bf597b88443: Status 404 returned error can't find the container with id 90f22b2ff5c602c623a722f58a6deec0f5262db326d10af4af229bf597b88443
Jul 13 17:16:46.977831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:46.977812    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:16:47.971033 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:47.970973    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf" event={"ID":"ce28563e-42f6-4748-8903-6f72b78a8bf7","Type":"ContainerStarted","Data":"90f22b2ff5c602c623a722f58a6deec0f5262db326d10af4af229bf597b88443"}
Jul 13 17:16:48.977383 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:48.977347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf" event={"ID":"ce28563e-42f6-4748-8903-6f72b78a8bf7","Type":"ContainerStarted","Data":"bbfd31d8cafa3876bb6d1a7132f932dd7ab0088e8151fe25c706f35e88c91f33"}
Jul 13 17:16:48.994055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:48.993994    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf" podStartSLOduration=1.870970701 podStartE2EDuration="2.993974028s" totalImagesPullingTime="1.123003327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:16:48.9920333 +0000 UTC m=+678.750633124" watchObservedRunningTime="2026-07-13 17:16:48.993974028 +0000 UTC m=+678.752573859"
Jul 13 17:16:56.844310 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:56.844268    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:56.844807 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:56.844451    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:56.856642 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:56.856615    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:16:57.024438 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:16:57.024411    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s9gpf"
Jul 13 17:17:05.516055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.516004    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"]
Jul 13 17:17:05.519264 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.519241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.521096 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.521077    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 17:17:05.527262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.527239    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"]
Jul 13 17:17:05.684396 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03488a88-a2bb-43da-9b13-299860e981a3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.684396 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.684615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wpt\" (UniqueName: \"kubernetes.io/projected/03488a88-a2bb-43da-9b13-299860e981a3-kube-api-access-54wpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.684615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.684615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.684615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.684564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785128 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785285 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03488a88-a2bb-43da-9b13-299860e981a3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785285 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785285 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54wpt\" (UniqueName: \"kubernetes.io/projected/03488a88-a2bb-43da-9b13-299860e981a3-kube-api-access-54wpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785285 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785285 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785547 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785625 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.785677 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.785631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.787445 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.787421    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03488a88-a2bb-43da-9b13-299860e981a3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.787630 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.787612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03488a88-a2bb-43da-9b13-299860e981a3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.792129 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.792111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wpt\" (UniqueName: \"kubernetes.io/projected/03488a88-a2bb-43da-9b13-299860e981a3-kube-api-access-54wpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4xrrj\" (UID: \"03488a88-a2bb-43da-9b13-299860e981a3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.831181 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.831143    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:05.968112 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:05.968083    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"]
Jul 13 17:17:05.970207 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:17:05.970178    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03488a88_a2bb_43da_9b13_299860e981a3.slice/crio-a0420d4ddfb3ae823c7082961258c686e612f8b972b9ab3052f167d2f53c5ba6 WatchSource:0}: Error finding container a0420d4ddfb3ae823c7082961258c686e612f8b972b9ab3052f167d2f53c5ba6: Status 404 returned error can't find the container with id a0420d4ddfb3ae823c7082961258c686e612f8b972b9ab3052f167d2f53c5ba6
Jul 13 17:17:06.060052 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:06.059955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj" event={"ID":"03488a88-a2bb-43da-9b13-299860e981a3","Type":"ContainerStarted","Data":"a0420d4ddfb3ae823c7082961258c686e612f8b972b9ab3052f167d2f53c5ba6"}
Jul 13 17:17:07.066451 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:07.066413    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj" event={"ID":"03488a88-a2bb-43da-9b13-299860e981a3","Type":"ContainerStarted","Data":"5a2a83cdfb9f81c925a3763d483a54798b43ef2609a9a827e8e51f4caa60c850"}
Jul 13 17:17:07.092131 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:07.092067    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj" podStartSLOduration=1.8645305479999998 podStartE2EDuration="2.0920505s" totalImagesPullingTime="227.519952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:07.090864648 +0000 UTC m=+696.849464480" watchObservedRunningTime="2026-07-13 17:17:07.0920505 +0000 UTC m=+696.850650332"
Jul 13 17:17:15.831434 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:15.831394    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:15.831856 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:15.831456    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:15.843894 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:15.843862    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:16.117902 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:16.117822    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4xrrj"
Jul 13 17:17:22.623928 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.623853    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"]
Jul 13 17:17:22.630845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.630820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.632660 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.632640    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 17:17:22.635590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.635719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.635719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.635719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.635719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74089b23-f138-4cf4-9525-2de4441dc0a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.636031 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.635761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffd4f\" (UniqueName: \"kubernetes.io/projected/74089b23-f138-4cf4-9525-2de4441dc0a4-kube-api-access-ffd4f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.641447 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.639318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"]
Jul 13 17:17:22.736653 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.736653 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74089b23-f138-4cf4-9525-2de4441dc0a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.736871 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffd4f\" (UniqueName: \"kubernetes.io/projected/74089b23-f138-4cf4-9525-2de4441dc0a4-kube-api-access-ffd4f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.736871 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.736871 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.737058 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.736925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.737193 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.737169    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.737245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.737209    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.737287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.737248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.738972 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.738949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74089b23-f138-4cf4-9525-2de4441dc0a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.739264 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.739241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74089b23-f138-4cf4-9525-2de4441dc0a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.744096 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.744073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffd4f\" (UniqueName: \"kubernetes.io/projected/74089b23-f138-4cf4-9525-2de4441dc0a4-kube-api-access-ffd4f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr\" (UID: \"74089b23-f138-4cf4-9525-2de4441dc0a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:22.943792 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:22.943757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:23.077225 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:23.077193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"]
Jul 13 17:17:23.080750 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:17:23.080723    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74089b23_f138_4cf4_9525_2de4441dc0a4.slice/crio-3213e1b642c25c613d6e1721adf99ead1b43dbf354b0a5e6b993c5726afe0134 WatchSource:0}: Error finding container 3213e1b642c25c613d6e1721adf99ead1b43dbf354b0a5e6b993c5726afe0134: Status 404 returned error can't find the container with id 3213e1b642c25c613d6e1721adf99ead1b43dbf354b0a5e6b993c5726afe0134
Jul 13 17:17:23.140704 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:23.140662    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr" event={"ID":"74089b23-f138-4cf4-9525-2de4441dc0a4","Type":"ContainerStarted","Data":"3213e1b642c25c613d6e1721adf99ead1b43dbf354b0a5e6b993c5726afe0134"}
Jul 13 17:17:24.146655 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:24.146612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr" event={"ID":"74089b23-f138-4cf4-9525-2de4441dc0a4","Type":"ContainerStarted","Data":"668e88550825fa2cfb762bee01fd3966017799ebab0f8fd782c2642eeb7e2d4c"}
Jul 13 17:17:24.166031 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:24.163674    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr" podStartSLOduration=1.940384847 podStartE2EDuration="2.163654546s" totalImagesPullingTime="223.269699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:24.162810026 +0000 UTC m=+713.921409858" watchObservedRunningTime="2026-07-13 17:17:24.163654546 +0000 UTC m=+713.922254584"
Jul 13 17:17:32.943871 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:32.943836    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:32.944365 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:32.943902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:32.957166 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:32.957138    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:17:33.203030 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:17:33.202938    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr"
Jul 13 17:18:34.577658 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.577615    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78c9d4f644-8l5gv"]
Jul 13 17:18:34.581480 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.581455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.586798 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.586771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78c9d4f644-8l5gv"]
Jul 13 17:18:34.688663 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.688631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86f8f6ca-e828-4855-98c3-b2f491b708f0-tls-cert\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.688824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.688691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww2cz\" (UniqueName: \"kubernetes.io/projected/86f8f6ca-e828-4855-98c3-b2f491b708f0-kube-api-access-ww2cz\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.790082 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.790048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww2cz\" (UniqueName: \"kubernetes.io/projected/86f8f6ca-e828-4855-98c3-b2f491b708f0-kube-api-access-ww2cz\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.790233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.790129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86f8f6ca-e828-4855-98c3-b2f491b708f0-tls-cert\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.792517 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.792488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86f8f6ca-e828-4855-98c3-b2f491b708f0-tls-cert\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.798147 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.798122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww2cz\" (UniqueName: \"kubernetes.io/projected/86f8f6ca-e828-4855-98c3-b2f491b708f0-kube-api-access-ww2cz\") pod \"authorino-78c9d4f644-8l5gv\" (UID: \"86f8f6ca-e828-4855-98c3-b2f491b708f0\") " pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:34.891348 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:34.891254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78c9d4f644-8l5gv"
Jul 13 17:18:35.034984 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:35.034958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78c9d4f644-8l5gv"]
Jul 13 17:18:35.037297 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:18:35.037267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86f8f6ca_e828_4855_98c3_b2f491b708f0.slice/crio-5b9f1787d66bc32b9ccbc31b0fcf965a5c4f451fbfec4759fd16fcc487dc590f WatchSource:0}: Error finding container 5b9f1787d66bc32b9ccbc31b0fcf965a5c4f451fbfec4759fd16fcc487dc590f: Status 404 returned error can't find the container with id 5b9f1787d66bc32b9ccbc31b0fcf965a5c4f451fbfec4759fd16fcc487dc590f
Jul 13 17:18:35.492839 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:35.492810    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78c9d4f644-8l5gv" event={"ID":"86f8f6ca-e828-4855-98c3-b2f491b708f0","Type":"ContainerStarted","Data":"5b9f1787d66bc32b9ccbc31b0fcf965a5c4f451fbfec4759fd16fcc487dc590f"}
Jul 13 17:18:36.501098 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.501055    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78c9d4f644-8l5gv" event={"ID":"86f8f6ca-e828-4855-98c3-b2f491b708f0","Type":"ContainerStarted","Data":"756c66c7ed7879dc21700218bda306980cb25151ee5e6194822ba7159d7623dd"}
Jul 13 17:18:36.563041 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.562327    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78c9d4f644-8l5gv" podStartSLOduration=2.150047037 podStartE2EDuration="2.562303942s" totalImagesPullingTime="412.256905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:36.526846297 +0000 UTC m=+786.285446131" watchObservedRunningTime="2026-07-13 17:18:36.562303942 +0000 UTC m=+786.320903775"
Jul 13 17:18:36.566976 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.565320    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:18:36.566976 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.565531    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" podUID="6c73586b-3e3d-4481-9eb8-3d84609aae55" containerName="authorino" containerID="cri-o://13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b" gracePeriod=30
Jul 13 17:18:36.819844 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.819814    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:18:36.910427 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.910390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert\") pod \"6c73586b-3e3d-4481-9eb8-3d84609aae55\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") "
Jul 13 17:18:36.910582 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.910447    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48fqj\" (UniqueName: \"kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj\") pod \"6c73586b-3e3d-4481-9eb8-3d84609aae55\" (UID: \"6c73586b-3e3d-4481-9eb8-3d84609aae55\") "
Jul 13 17:18:36.912911 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.912873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj" (OuterVolumeSpecName: "kube-api-access-48fqj") pod "6c73586b-3e3d-4481-9eb8-3d84609aae55" (UID: "6c73586b-3e3d-4481-9eb8-3d84609aae55"). InnerVolumeSpecName "kube-api-access-48fqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:18:36.921508 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:36.921479    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6c73586b-3e3d-4481-9eb8-3d84609aae55" (UID: "6c73586b-3e3d-4481-9eb8-3d84609aae55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:18:37.012197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.012158    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48fqj\" (UniqueName: \"kubernetes.io/projected/6c73586b-3e3d-4481-9eb8-3d84609aae55-kube-api-access-48fqj\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:18:37.012197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.012189    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c73586b-3e3d-4481-9eb8-3d84609aae55-tls-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:18:37.506887 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.506854    2567 generic.go:356] "Generic (PLEG): container finished" podID="6c73586b-3e3d-4481-9eb8-3d84609aae55" containerID="13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b" exitCode=0
Jul 13 17:18:37.507387 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.506908    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq"
Jul 13 17:18:37.507387 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.506956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" event={"ID":"6c73586b-3e3d-4481-9eb8-3d84609aae55","Type":"ContainerDied","Data":"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"}
Jul 13 17:18:37.507387 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.507026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8fc99f97-ns2wq" event={"ID":"6c73586b-3e3d-4481-9eb8-3d84609aae55","Type":"ContainerDied","Data":"97e8b2f1c06621c3a0ec8dc36d7fabb1224b7b5e90633ad931b235f4e2830639"}
Jul 13 17:18:37.507387 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.507053    2567 scope.go:117] "RemoveContainer" containerID="13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"
Jul 13 17:18:37.523635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.523612    2567 scope.go:117] "RemoveContainer" containerID="13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"
Jul 13 17:18:37.523957 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:18:37.523933    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b\": container with ID starting with 13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b not found: ID does not exist" containerID="13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"
Jul 13 17:18:37.524037 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.523964    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b"} err="failed to get container status \"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b\": rpc error: code = NotFound desc = could not find container \"13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b\": container with ID starting with 13cf8179d0f1e06bf29def1ac77468d57a5934e81283cc5fbce5d6fd2a2bbc7b not found: ID does not exist"
Jul 13 17:18:37.535557 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.535517    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:18:37.539643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:37.539614    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d8fc99f97-ns2wq"]
Jul 13 17:18:38.895382 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:18:38.895353    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c73586b-3e3d-4481-9eb8-3d84609aae55" path="/var/lib/kubelet/pods/6c73586b-3e3d-4481-9eb8-3d84609aae55/volumes"
Jul 13 17:20:30.806850 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:20:30.806757    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:20:30.808222 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:20:30.808196    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:25:30.837882 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:25:30.837855    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:25:30.837882 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:25:30.837871    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:30:30.869175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:30:30.869147    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:30:30.870078 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:30:30.870060    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:32:36.712587 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.712553    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:32:36.713116 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.712971    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c73586b-3e3d-4481-9eb8-3d84609aae55" containerName="authorino"
Jul 13 17:32:36.713116 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.712983    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c73586b-3e3d-4481-9eb8-3d84609aae55" containerName="authorino"
Jul 13 17:32:36.713116 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.713075    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c73586b-3e3d-4481-9eb8-3d84609aae55" containerName="authorino"
Jul 13 17:32:36.716211 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.716187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.718488 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.718469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-85580aa7-serving-cert\""
Jul 13 17:32:36.726786 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.726764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:32:36.794467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.794431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.794467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.794470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.794675 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.794533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h5fw\" (UniqueName: \"kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.895717 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.895682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h5fw\" (UniqueName: \"kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.895889 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.895797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.895889 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.895816    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.896453 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.896427    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.898307 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.898285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:36.905516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:36.905488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h5fw\" (UniqueName: \"kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw\") pod \"maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:37.026996 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:37.026912    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:37.161308 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:37.161275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:32:37.163358 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:32:37.163317    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dabd53_c712_4713_b109_45094b41c7b8.slice/crio-39466d4980c639c151075e652837b888149529f000099ef1e39d3b238bf48564 WatchSource:0}: Error finding container 39466d4980c639c151075e652837b888149529f000099ef1e39d3b238bf48564: Status 404 returned error can't find the container with id 39466d4980c639c151075e652837b888149529f000099ef1e39d3b238bf48564
Jul 13 17:32:37.164626 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:37.164606    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:32:37.509279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:37.509234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" event={"ID":"f1dabd53-c712-4713-b109-45094b41c7b8","Type":"ContainerStarted","Data":"39466d4980c639c151075e652837b888149529f000099ef1e39d3b238bf48564"}
Jul 13 17:32:38.515621 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:38.515583    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" event={"ID":"f1dabd53-c712-4713-b109-45094b41c7b8","Type":"ContainerStarted","Data":"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"}
Jul 13 17:32:38.515995 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:38.515666    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:32:38.533784 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:38.533736    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" podStartSLOduration=2.031764401 podStartE2EDuration="2.533720879s" totalImagesPullingTime="501.956478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:38.53233386 +0000 UTC m=+1628.290933694" watchObservedRunningTime="2026-07-13 17:32:38.533720879 +0000 UTC m=+1628.292320710"
Jul 13 17:32:44.527350 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:32:44.527320    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:33:42.074603 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.074563    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:33:42.077119 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.075116    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" podUID="f1dabd53-c712-4713-b109-45094b41c7b8" containerName="maas-api" containerID="cri-o://4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6" gracePeriod=30
Jul 13 17:33:42.322437 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.322412    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:33:42.409509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.409422    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls\") pod \"f1dabd53-c712-4713-b109-45094b41c7b8\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") "
Jul 13 17:33:42.409509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.409463    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca\") pod \"f1dabd53-c712-4713-b109-45094b41c7b8\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") "
Jul 13 17:33:42.409509 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.409503    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h5fw\" (UniqueName: \"kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw\") pod \"f1dabd53-c712-4713-b109-45094b41c7b8\" (UID: \"f1dabd53-c712-4713-b109-45094b41c7b8\") "
Jul 13 17:33:42.409841 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.409815    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1dabd53-c712-4713-b109-45094b41c7b8" (UID: "f1dabd53-c712-4713-b109-45094b41c7b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:33:42.411670 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.411637    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1dabd53-c712-4713-b109-45094b41c7b8" (UID: "f1dabd53-c712-4713-b109-45094b41c7b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:33:42.411943 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.411733    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw" (OuterVolumeSpecName: "kube-api-access-2h5fw") pod "f1dabd53-c712-4713-b109-45094b41c7b8" (UID: "f1dabd53-c712-4713-b109-45094b41c7b8"). InnerVolumeSpecName "kube-api-access-2h5fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:33:42.510429 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.510388    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1dabd53-c712-4713-b109-45094b41c7b8-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:33:42.510429 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.510420    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1dabd53-c712-4713-b109-45094b41c7b8-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:33:42.510429 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.510430    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h5fw\" (UniqueName: \"kubernetes.io/projected/f1dabd53-c712-4713-b109-45094b41c7b8-kube-api-access-2h5fw\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:33:42.836757 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.836722    2567 generic.go:356] "Generic (PLEG): container finished" podID="f1dabd53-c712-4713-b109-45094b41c7b8" containerID="4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6" exitCode=0
Jul 13 17:33:42.836936 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.836765    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"
Jul 13 17:33:42.836936 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.836777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" event={"ID":"f1dabd53-c712-4713-b109-45094b41c7b8","Type":"ContainerDied","Data":"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"}
Jul 13 17:33:42.836936 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.836828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59" event={"ID":"f1dabd53-c712-4713-b109-45094b41c7b8","Type":"ContainerDied","Data":"39466d4980c639c151075e652837b888149529f000099ef1e39d3b238bf48564"}
Jul 13 17:33:42.836936 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.836850    2567 scope.go:117] "RemoveContainer" containerID="4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"
Jul 13 17:33:42.845809 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.845790    2567 scope.go:117] "RemoveContainer" containerID="4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"
Jul 13 17:33:42.846079 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:33:42.846048    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6\": container with ID starting with 4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6 not found: ID does not exist" containerID="4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"
Jul 13 17:33:42.846160 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.846084    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6"} err="failed to get container status \"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6\": rpc error: code = NotFound desc = could not find container \"4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6\": container with ID starting with 4c02c53bb192605006e9712a38ab9c45303ef8ba9052dc0181e8a6d399714bc6 not found: ID does not exist"
Jul 13 17:33:42.856425 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.856401    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:33:42.859709 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.859684    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85580aa7-7449b5bb79-lrj59"]
Jul 13 17:33:42.895831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:42.895802    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1dabd53-c712-4713-b109-45094b41c7b8" path="/var/lib/kubelet/pods/f1dabd53-c712-4713-b109-45094b41c7b8/volumes"
Jul 13 17:33:58.558233 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.558198    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:33:58.558640 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.558604    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dabd53-c712-4713-b109-45094b41c7b8" containerName="maas-api"
Jul 13 17:33:58.558640 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.558616    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dabd53-c712-4713-b109-45094b41c7b8" containerName="maas-api"
Jul 13 17:33:58.558714 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.558686    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1dabd53-c712-4713-b109-45094b41c7b8" containerName="maas-api"
Jul 13 17:33:58.563365 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.563343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.566201 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.566176    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0e7283f7-serving-cert\""
Jul 13 17:33:58.572660 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.572633    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:33:58.657777 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.657730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x99f8\" (UniqueName: \"kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.657777 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.657777    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.657992 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.657815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.758687 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.758641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x99f8\" (UniqueName: \"kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.758687 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.758682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.758967 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.758714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.758967 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:33:58.758809    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-serving-cert: secret "maas-api-e2e-ait-0e7283f7-serving-cert" not found
Jul 13 17:33:58.758967 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:33:58.758874    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls podName:56c490a5-0af9-4612-a884-968f14fa209c nodeName:}" failed. No retries permitted until 2026-07-13 17:33:59.258857196 +0000 UTC m=+1709.017457006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls") pod "maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" (UID: "56c490a5-0af9-4612-a884-968f14fa209c") : secret "maas-api-e2e-ait-0e7283f7-serving-cert" not found
Jul 13 17:33:58.759454 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.759428    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:58.768278 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:58.768250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x99f8\" (UniqueName: \"kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:59.263765 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:59.263724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:59.266143 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:59.266122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") pod \"maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:59.474549 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:59.474511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:33:59.608701 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:59.608674    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:33:59.610953 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:33:59.610925    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c490a5_0af9_4612_a884_968f14fa209c.slice/crio-f3817a1ccf0bdeb309105d699c33658a045184cfa7eed20cb725834d210ba96c WatchSource:0}: Error finding container f3817a1ccf0bdeb309105d699c33658a045184cfa7eed20cb725834d210ba96c: Status 404 returned error can't find the container with id f3817a1ccf0bdeb309105d699c33658a045184cfa7eed20cb725834d210ba96c
Jul 13 17:33:59.920837 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:33:59.920745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" event={"ID":"56c490a5-0af9-4612-a884-968f14fa209c","Type":"ContainerStarted","Data":"f3817a1ccf0bdeb309105d699c33658a045184cfa7eed20cb725834d210ba96c"}
Jul 13 17:34:00.927787 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:34:00.927753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" event={"ID":"56c490a5-0af9-4612-a884-968f14fa209c","Type":"ContainerStarted","Data":"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"}
Jul 13 17:34:00.928279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:34:00.927947    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:34:00.944615 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:34:00.944566    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" podStartSLOduration=2.433651438 podStartE2EDuration="2.944548118s" totalImagesPullingTime="510.89668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:34:00.943479727 +0000 UTC m=+1710.702079550" watchObservedRunningTime="2026-07-13 17:34:00.944548118 +0000 UTC m=+1710.703147942"
Jul 13 17:34:06.938003 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:34:06.937967    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:35:04.153131 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.153087    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:35:04.153712 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.153351    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" podUID="56c490a5-0af9-4612-a884-968f14fa209c" containerName="maas-api" containerID="cri-o://f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5" gracePeriod=30
Jul 13 17:35:04.399429 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.399403    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:35:04.469322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.469287    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") pod \"56c490a5-0af9-4612-a884-968f14fa209c\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") "
Jul 13 17:35:04.469485 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.469326    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x99f8\" (UniqueName: \"kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8\") pod \"56c490a5-0af9-4612-a884-968f14fa209c\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") "
Jul 13 17:35:04.469485 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.469468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca\") pod \"56c490a5-0af9-4612-a884-968f14fa209c\" (UID: \"56c490a5-0af9-4612-a884-968f14fa209c\") "
Jul 13 17:35:04.469823 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.469799    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56c490a5-0af9-4612-a884-968f14fa209c" (UID: "56c490a5-0af9-4612-a884-968f14fa209c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:35:04.471388 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.471363    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56c490a5-0af9-4612-a884-968f14fa209c" (UID: "56c490a5-0af9-4612-a884-968f14fa209c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:35:04.471502 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.471402    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8" (OuterVolumeSpecName: "kube-api-access-x99f8") pod "56c490a5-0af9-4612-a884-968f14fa209c" (UID: "56c490a5-0af9-4612-a884-968f14fa209c"). InnerVolumeSpecName "kube-api-access-x99f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:35:04.570282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.570246    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56c490a5-0af9-4612-a884-968f14fa209c-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:35:04.570282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.570277    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56c490a5-0af9-4612-a884-968f14fa209c-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:35:04.570282 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:04.570287    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x99f8\" (UniqueName: \"kubernetes.io/projected/56c490a5-0af9-4612-a884-968f14fa209c-kube-api-access-x99f8\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:35:05.228934 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.228897    2567 generic.go:356] "Generic (PLEG): container finished" podID="56c490a5-0af9-4612-a884-968f14fa209c" containerID="f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5" exitCode=0
Jul 13 17:35:05.229390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.228940    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"
Jul 13 17:35:05.229390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.228983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" event={"ID":"56c490a5-0af9-4612-a884-968f14fa209c","Type":"ContainerDied","Data":"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"}
Jul 13 17:35:05.229390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.229062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq" event={"ID":"56c490a5-0af9-4612-a884-968f14fa209c","Type":"ContainerDied","Data":"f3817a1ccf0bdeb309105d699c33658a045184cfa7eed20cb725834d210ba96c"}
Jul 13 17:35:05.229390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.229091    2567 scope.go:117] "RemoveContainer" containerID="f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"
Jul 13 17:35:05.237919 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.237900    2567 scope.go:117] "RemoveContainer" containerID="f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"
Jul 13 17:35:05.238217 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:35:05.238198    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5\": container with ID starting with f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5 not found: ID does not exist" containerID="f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"
Jul 13 17:35:05.238293 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.238225    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5"} err="failed to get container status \"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5\": rpc error: code = NotFound desc = could not find container \"f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5\": container with ID starting with f32420bbac1b2e7279a50afc5aca50dd86b689b881708e64748e26600708d4c5 not found: ID does not exist"
Jul 13 17:35:05.245080 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.245055    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:35:05.247742 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:05.247717    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e7283f7-75575bbcd-h44gq"]
Jul 13 17:35:06.895108 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:06.895076    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56c490a5-0af9-4612-a884-968f14fa209c" path="/var/lib/kubelet/pods/56c490a5-0af9-4612-a884-968f14fa209c/volumes"
Jul 13 17:35:21.278087 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.278050    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:35:21.278496 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.278433    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c490a5-0af9-4612-a884-968f14fa209c" containerName="maas-api"
Jul 13 17:35:21.278496 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.278444    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c490a5-0af9-4612-a884-968f14fa209c" containerName="maas-api"
Jul 13 17:35:21.278581 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.278508    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56c490a5-0af9-4612-a884-968f14fa209c" containerName="maas-api"
Jul 13 17:35:21.281627 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.281605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.284833 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:35:21.284802    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.292512 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:35:21.292482    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-derive-8e6203f1-serving-cert\" is forbidden: User \"system:node:ip-10-0-138-241.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-138-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8e6203f1-serving-cert\"" type="*v1.Secret"
Jul 13 17:35:21.321129 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.321097    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:35:21.325045 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.325005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8rw\" (UniqueName: \"kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.325180 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.325105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.325245 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.325186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.426409 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.426370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.426578 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.426428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8rw\" (UniqueName: \"kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.426578 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.426482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.427192 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.427172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:21.441719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:21.441693    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8rw\" (UniqueName: \"kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:22.427042 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:35:22.426933    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 13 17:35:22.427402 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:35:22.427053    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls podName:ca30355c-9192-432f-b898-f5fb2937f5ad nodeName:}" failed. No retries permitted until 2026-07-13 17:35:22.927031137 +0000 UTC m=+1792.685630962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls") pod "maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" (UID: "ca30355c-9192-432f-b898-f5fb2937f5ad") : failed to sync secret cache: timed out waiting for the condition
Jul 13 17:35:22.595000 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:22.594969    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8e6203f1-serving-cert\""
Jul 13 17:35:22.941268 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:22.941232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:22.943641 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:22.943611    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") pod \"maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:23.092191 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:23.092157    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:23.218795 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:23.218769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:35:23.221351 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:35:23.221311    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca30355c_9192_432f_b898_f5fb2937f5ad.slice/crio-efc3f45bc176f6513e7ea782a2a1bce6091e71db192693946ccdc956076b698f WatchSource:0}: Error finding container efc3f45bc176f6513e7ea782a2a1bce6091e71db192693946ccdc956076b698f: Status 404 returned error can't find the container with id efc3f45bc176f6513e7ea782a2a1bce6091e71db192693946ccdc956076b698f
Jul 13 17:35:23.315166 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:23.315128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" event={"ID":"ca30355c-9192-432f-b898-f5fb2937f5ad","Type":"ContainerStarted","Data":"efc3f45bc176f6513e7ea782a2a1bce6091e71db192693946ccdc956076b698f"}
Jul 13 17:35:24.321187 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:24.321151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" event={"ID":"ca30355c-9192-432f-b898-f5fb2937f5ad","Type":"ContainerStarted","Data":"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"}
Jul 13 17:35:24.321598 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:24.321279    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:24.336876 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:24.336819    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" podStartSLOduration=2.711236611 podStartE2EDuration="3.336802607s" totalImagesPullingTime="625.565996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:35:24.335627034 +0000 UTC m=+1794.094226868" watchObservedRunningTime="2026-07-13 17:35:24.336802607 +0000 UTC m=+1794.095402438"
Jul 13 17:35:30.332713 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:30.332681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:35:30.903815 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:30.903785    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:35:30.906155 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:35:30.906134    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:36:26.066357 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.066315    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:36:26.066924 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.066578    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" containerName="maas-api" containerID="cri-o://5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4" gracePeriod=30
Jul 13 17:36:26.309978 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.309950    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:36:26.437130 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.437102    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") pod \"ca30355c-9192-432f-b898-f5fb2937f5ad\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") "
Jul 13 17:36:26.437298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.437164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca\") pod \"ca30355c-9192-432f-b898-f5fb2937f5ad\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") "
Jul 13 17:36:26.437298 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.437196    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp8rw\" (UniqueName: \"kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw\") pod \"ca30355c-9192-432f-b898-f5fb2937f5ad\" (UID: \"ca30355c-9192-432f-b898-f5fb2937f5ad\") "
Jul 13 17:36:26.437536 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.437511    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca30355c-9192-432f-b898-f5fb2937f5ad" (UID: "ca30355c-9192-432f-b898-f5fb2937f5ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:36:26.439334 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.439307    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca30355c-9192-432f-b898-f5fb2937f5ad" (UID: "ca30355c-9192-432f-b898-f5fb2937f5ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:36:26.439479 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.439347    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw" (OuterVolumeSpecName: "kube-api-access-tp8rw") pod "ca30355c-9192-432f-b898-f5fb2937f5ad" (UID: "ca30355c-9192-432f-b898-f5fb2937f5ad"). InnerVolumeSpecName "kube-api-access-tp8rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:36:26.538580 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.538547    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca30355c-9192-432f-b898-f5fb2937f5ad-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:36:26.538580 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.538574    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca30355c-9192-432f-b898-f5fb2937f5ad-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:36:26.538779 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.538588    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8rw\" (UniqueName: \"kubernetes.io/projected/ca30355c-9192-432f-b898-f5fb2937f5ad-kube-api-access-tp8rw\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:36:26.614921 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.614886    2567 generic.go:356] "Generic (PLEG): container finished" podID="ca30355c-9192-432f-b898-f5fb2937f5ad" containerID="5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4" exitCode=0
Jul 13 17:36:26.614921 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.614922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" event={"ID":"ca30355c-9192-432f-b898-f5fb2937f5ad","Type":"ContainerDied","Data":"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"}
Jul 13 17:36:26.615143 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.614932    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"
Jul 13 17:36:26.615143 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.614961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp" event={"ID":"ca30355c-9192-432f-b898-f5fb2937f5ad","Type":"ContainerDied","Data":"efc3f45bc176f6513e7ea782a2a1bce6091e71db192693946ccdc956076b698f"}
Jul 13 17:36:26.615143 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.614983    2567 scope.go:117] "RemoveContainer" containerID="5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"
Jul 13 17:36:26.623866 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.623849    2567 scope.go:117] "RemoveContainer" containerID="5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"
Jul 13 17:36:26.624144 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:36:26.624126    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4\": container with ID starting with 5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4 not found: ID does not exist" containerID="5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"
Jul 13 17:36:26.624210 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.624152    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4"} err="failed to get container status \"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4\": rpc error: code = NotFound desc = could not find container \"5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4\": container with ID starting with 5711e006282a9eefb6144d8a97022b424490b9d537c23369d9aef3bc51a3c2d4 not found: ID does not exist"
Jul 13 17:36:26.634631 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.634600    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:36:26.636837 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.636815    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e6203f1-77c4b7496d-99grp"]
Jul 13 17:36:26.894803 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:36:26.894705    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" path="/var/lib/kubelet/pods/ca30355c-9192-432f-b898-f5fb2937f5ad/volumes"
Jul 13 17:38:19.061759 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.061723    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:19.062286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.062147    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" containerName="maas-api"
Jul 13 17:38:19.062286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.062160    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" containerName="maas-api"
Jul 13 17:38:19.062286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.062241    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca30355c-9192-432f-b898-f5fb2937f5ad" containerName="maas-api"
Jul 13 17:38:19.065222 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.065205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.067109 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.067082    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b8ebfd6b-serving-cert\""
Jul 13 17:38:19.075794 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.075768    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:19.214780 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.214746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.214987 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.214806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcxw\" (UniqueName: \"kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.214987 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.214892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.315937 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.315853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcxw\" (UniqueName: \"kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.315937 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.315927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.316190 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.316005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.316190 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:38:19.316136    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-serving-cert: secret "maas-api-e2e-mt-b8ebfd6b-serving-cert" not found
Jul 13 17:38:19.316284 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:38:19.316232    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls podName:88964c19-e208-4269-93a8-ee20c2b24d85 nodeName:}" failed. No retries permitted until 2026-07-13 17:38:19.816209251 +0000 UTC m=+1969.574809064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls") pod "maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" (UID: "88964c19-e208-4269-93a8-ee20c2b24d85") : secret "maas-api-e2e-mt-b8ebfd6b-serving-cert" not found
Jul 13 17:38:19.316567 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.316549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.327356 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.327334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcxw\" (UniqueName: \"kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.819987 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.819948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.822443 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.822415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") pod \"maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:19.975987 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:19.975938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:20.113195 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:20.113152    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:20.115596 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:38:20.115565    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88964c19_e208_4269_93a8_ee20c2b24d85.slice/crio-e522c8709c1b76a032706375be82cd4ab756aaf49410c1d454ddd4bb55c85826 WatchSource:0}: Error finding container e522c8709c1b76a032706375be82cd4ab756aaf49410c1d454ddd4bb55c85826: Status 404 returned error can't find the container with id e522c8709c1b76a032706375be82cd4ab756aaf49410c1d454ddd4bb55c85826
Jul 13 17:38:20.116892 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:20.116870    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:38:20.147611 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:20.147579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" event={"ID":"88964c19-e208-4269-93a8-ee20c2b24d85","Type":"ContainerStarted","Data":"e522c8709c1b76a032706375be82cd4ab756aaf49410c1d454ddd4bb55c85826"}
Jul 13 17:38:21.153735 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:21.153699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" event={"ID":"88964c19-e208-4269-93a8-ee20c2b24d85","Type":"ContainerStarted","Data":"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"}
Jul 13 17:38:21.154162 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:21.153787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:21.169450 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:21.169406    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" podStartSLOduration=1.630071665 podStartE2EDuration="2.169391206s" totalImagesPullingTime="539.319541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:21.167841731 +0000 UTC m=+1970.926441564" watchObservedRunningTime="2026-07-13 17:38:21.169391206 +0000 UTC m=+1970.927991032"
Jul 13 17:38:27.163646 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:27.163564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:41.496279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.496243    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:41.496722 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.496429    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" podUID="88964c19-e208-4269-93a8-ee20c2b24d85" containerName="maas-api" containerID="cri-o://26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569" gracePeriod=30
Jul 13 17:38:41.744752 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.744724    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:41.818654 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.818551    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtcxw\" (UniqueName: \"kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw\") pod \"88964c19-e208-4269-93a8-ee20c2b24d85\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") "
Jul 13 17:38:41.818654 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.818588    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca\") pod \"88964c19-e208-4269-93a8-ee20c2b24d85\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") "
Jul 13 17:38:41.818654 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.818613    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") pod \"88964c19-e208-4269-93a8-ee20c2b24d85\" (UID: \"88964c19-e208-4269-93a8-ee20c2b24d85\") "
Jul 13 17:38:41.819038 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.818958    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88964c19-e208-4269-93a8-ee20c2b24d85" (UID: "88964c19-e208-4269-93a8-ee20c2b24d85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:38:41.820712 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.820675    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw" (OuterVolumeSpecName: "kube-api-access-qtcxw") pod "88964c19-e208-4269-93a8-ee20c2b24d85" (UID: "88964c19-e208-4269-93a8-ee20c2b24d85"). InnerVolumeSpecName "kube-api-access-qtcxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:38:41.821099 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.821076    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88964c19-e208-4269-93a8-ee20c2b24d85" (UID: "88964c19-e208-4269-93a8-ee20c2b24d85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:38:41.919820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.919787    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtcxw\" (UniqueName: \"kubernetes.io/projected/88964c19-e208-4269-93a8-ee20c2b24d85-kube-api-access-qtcxw\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:38:41.919820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.919814    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88964c19-e208-4269-93a8-ee20c2b24d85-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:38:41.919820 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:41.919824    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88964c19-e208-4269-93a8-ee20c2b24d85-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:38:42.254368 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.254330    2567 generic.go:356] "Generic (PLEG): container finished" podID="88964c19-e208-4269-93a8-ee20c2b24d85" containerID="26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569" exitCode=0
Jul 13 17:38:42.256481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.254405    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"
Jul 13 17:38:42.256481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.254411    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" event={"ID":"88964c19-e208-4269-93a8-ee20c2b24d85","Type":"ContainerDied","Data":"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"}
Jul 13 17:38:42.256481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.254464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph" event={"ID":"88964c19-e208-4269-93a8-ee20c2b24d85","Type":"ContainerDied","Data":"e522c8709c1b76a032706375be82cd4ab756aaf49410c1d454ddd4bb55c85826"}
Jul 13 17:38:42.256481 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.254486    2567 scope.go:117] "RemoveContainer" containerID="26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"
Jul 13 17:38:42.263824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.263808    2567 scope.go:117] "RemoveContainer" containerID="26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"
Jul 13 17:38:42.264100 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:38:42.264077    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569\": container with ID starting with 26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569 not found: ID does not exist" containerID="26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"
Jul 13 17:38:42.264198 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.264107    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569"} err="failed to get container status \"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569\": rpc error: code = NotFound desc = could not find container \"26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569\": container with ID starting with 26b189f32a08b3b356ce33bc19651c2e888585212a3cd8ff239cdea7054e0569 not found: ID does not exist"
Jul 13 17:38:42.277869 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.277841    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:42.283354 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.283332    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8ebfd6b-7cdb96db54-r4xph"]
Jul 13 17:38:42.895339 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:38:42.895306    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88964c19-e208-4269-93a8-ee20c2b24d85" path="/var/lib/kubelet/pods/88964c19-e208-4269-93a8-ee20c2b24d85/volumes"
Jul 13 17:39:20.622935 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.622890    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:39:20.623412 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.623324    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88964c19-e208-4269-93a8-ee20c2b24d85" containerName="maas-api"
Jul 13 17:39:20.623412 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.623337    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="88964c19-e208-4269-93a8-ee20c2b24d85" containerName="maas-api"
Jul 13 17:39:20.623412 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.623397    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="88964c19-e208-4269-93a8-ee20c2b24d85" containerName="maas-api"
Jul 13 17:39:20.626452 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.626433    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.629764 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.629744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f4b51184-serving-cert\""
Jul 13 17:39:20.647721 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.647688    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:39:20.691414 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.691382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5k6\" (UniqueName: \"kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.691560 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.691425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.691560 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.691443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.792328 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.792285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5k6\" (UniqueName: \"kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.792501 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.792348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.792501 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.792376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.792592 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:39:20.792508    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-serving-cert: secret "maas-api-e2e-mt-f4b51184-serving-cert" not found
Jul 13 17:39:20.792592 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:39:20.792589    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls podName:55a06ed0-901f-4b45-b8d6-66eb29ea17b1 nodeName:}" failed. No retries permitted until 2026-07-13 17:39:21.292567776 +0000 UTC m=+2031.051167586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls") pod "maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" (UID: "55a06ed0-901f-4b45-b8d6-66eb29ea17b1") : secret "maas-api-e2e-mt-f4b51184-serving-cert" not found
Jul 13 17:39:20.793063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.793005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:20.801154 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:20.801131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5k6\" (UniqueName: \"kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:21.296218 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:21.296172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:21.298656 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:21.298630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") pod \"maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:21.538220 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:21.538184    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:21.675697 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:21.675661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:39:21.678575 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:39:21.678549    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a06ed0_901f_4b45_b8d6_66eb29ea17b1.slice/crio-909037702b7f9679a6d41a92b2a5da673807474cebed131f961d7103057bf4e0 WatchSource:0}: Error finding container 909037702b7f9679a6d41a92b2a5da673807474cebed131f961d7103057bf4e0: Status 404 returned error can't find the container with id 909037702b7f9679a6d41a92b2a5da673807474cebed131f961d7103057bf4e0
Jul 13 17:39:22.445571 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:22.445536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" event={"ID":"55a06ed0-901f-4b45-b8d6-66eb29ea17b1","Type":"ContainerStarted","Data":"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"}
Jul 13 17:39:22.445754 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:22.445595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" event={"ID":"55a06ed0-901f-4b45-b8d6-66eb29ea17b1","Type":"ContainerStarted","Data":"909037702b7f9679a6d41a92b2a5da673807474cebed131f961d7103057bf4e0"}
Jul 13 17:39:22.445754 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:22.445639    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:39:22.465046 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:22.464990    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" podStartSLOduration=2.048196836 podStartE2EDuration="2.464974859s" totalImagesPullingTime="416.778023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:39:22.46295238 +0000 UTC m=+2032.221552212" watchObservedRunningTime="2026-07-13 17:39:22.464974859 +0000 UTC m=+2032.223574692"
Jul 13 17:39:28.456702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:39:28.456665    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:40:03.596788 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.596699    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:40:03.597290 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.596904    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" podUID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" containerName="maas-api" containerID="cri-o://c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9" gracePeriod=30
Jul 13 17:40:03.843851 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.843826    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:40:03.985055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.984981    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") pod \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") "
Jul 13 17:40:03.985230 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.985087    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca\") pod \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") "
Jul 13 17:40:03.985230 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.985158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k5k6\" (UniqueName: \"kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6\") pod \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\" (UID: \"55a06ed0-901f-4b45-b8d6-66eb29ea17b1\") "
Jul 13 17:40:03.986258 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.985467    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55a06ed0-901f-4b45-b8d6-66eb29ea17b1" (UID: "55a06ed0-901f-4b45-b8d6-66eb29ea17b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:40:03.986258 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.985785    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:40:03.987239 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.987212    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55a06ed0-901f-4b45-b8d6-66eb29ea17b1" (UID: "55a06ed0-901f-4b45-b8d6-66eb29ea17b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:40:03.987369 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:03.987352    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6" (OuterVolumeSpecName: "kube-api-access-7k5k6") pod "55a06ed0-901f-4b45-b8d6-66eb29ea17b1" (UID: "55a06ed0-901f-4b45-b8d6-66eb29ea17b1"). InnerVolumeSpecName "kube-api-access-7k5k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:40:04.087075 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.087038    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k5k6\" (UniqueName: \"kubernetes.io/projected/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-kube-api-access-7k5k6\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:40:04.087075 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.087071    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a06ed0-901f-4b45-b8d6-66eb29ea17b1-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:40:04.655303 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.655268    2567 generic.go:356] "Generic (PLEG): container finished" podID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" containerID="c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9" exitCode=0
Jul 13 17:40:04.655719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.655312    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"
Jul 13 17:40:04.655719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.655354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" event={"ID":"55a06ed0-901f-4b45-b8d6-66eb29ea17b1","Type":"ContainerDied","Data":"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"}
Jul 13 17:40:04.655719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.655403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm" event={"ID":"55a06ed0-901f-4b45-b8d6-66eb29ea17b1","Type":"ContainerDied","Data":"909037702b7f9679a6d41a92b2a5da673807474cebed131f961d7103057bf4e0"}
Jul 13 17:40:04.655719 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.655425    2567 scope.go:117] "RemoveContainer" containerID="c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"
Jul 13 17:40:04.664126 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.664107    2567 scope.go:117] "RemoveContainer" containerID="c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"
Jul 13 17:40:04.664391 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:40:04.664373    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9\": container with ID starting with c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9 not found: ID does not exist" containerID="c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"
Jul 13 17:40:04.664454 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.664404    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9"} err="failed to get container status \"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9\": rpc error: code = NotFound desc = could not find container \"c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9\": container with ID starting with c3a6596710effdf64e52414552e911348f359b15a6a44cbc1e430e88b14d28a9 not found: ID does not exist"
Jul 13 17:40:04.677623 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.677600    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:40:04.686396 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.686373    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4b51184-c7f9d59bd-wd5zm"]
Jul 13 17:40:04.894643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:04.894612    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" path="/var/lib/kubelet/pods/55a06ed0-901f-4b45-b8d6-66eb29ea17b1/volumes"
Jul 13 17:40:30.933658 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:30.933621    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:40:30.938386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:40:30.938364    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:41:59.310148 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.310100    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:41:59.310717 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.310697    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" containerName="maas-api"
Jul 13 17:41:59.310802 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.310720    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" containerName="maas-api"
Jul 13 17:41:59.310855 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.310830    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a06ed0-901f-4b45-b8d6-66eb29ea17b1" containerName="maas-api"
Jul 13 17:41:59.314056 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.314034    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.317254 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.317232    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6a3680-serving-cert\""
Jul 13 17:41:59.329638 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.329603    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:41:59.439759 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.439701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.439950 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.439817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5k2\" (UniqueName: \"kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.439950 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.439887    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.540750 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.540715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.540973 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.540769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5k2\" (UniqueName: \"kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.540973 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.540823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.541428 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.541402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.543172 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.543147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.552083 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.551995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5k2\" (UniqueName: \"kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2\") pod \"maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.626048 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.625971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:41:59.763087 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:41:59.763057    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:41:59.765512 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:41:59.765483    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49fd0d4_cc28_4b6d_a051_72fada50636a.slice/crio-023e2a6e1fd8887880ddda250fd1a59163c4f7e912eb03d6bbf98ee8c5b28597 WatchSource:0}: Error finding container 023e2a6e1fd8887880ddda250fd1a59163c4f7e912eb03d6bbf98ee8c5b28597: Status 404 returned error can't find the container with id 023e2a6e1fd8887880ddda250fd1a59163c4f7e912eb03d6bbf98ee8c5b28597
Jul 13 17:42:00.196213 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:00.196181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" event={"ID":"a49fd0d4-cc28-4b6d-a051-72fada50636a","Type":"ContainerStarted","Data":"023e2a6e1fd8887880ddda250fd1a59163c4f7e912eb03d6bbf98ee8c5b28597"}
Jul 13 17:42:01.202262 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:01.202224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" event={"ID":"a49fd0d4-cc28-4b6d-a051-72fada50636a","Type":"ContainerStarted","Data":"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"}
Jul 13 17:42:01.202643 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:01.202322    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:42:01.228645 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:01.228597    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" podStartSLOduration=1.5399596039999999 podStartE2EDuration="2.228582779s" totalImagesPullingTime="688.623175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:42:01.228212711 +0000 UTC m=+2190.986812543" watchObservedRunningTime="2026-07-13 17:42:01.228582779 +0000 UTC m=+2190.987182610"
Jul 13 17:42:07.212447 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.212415    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:42:07.343321 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.343288    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:42:07.346848 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.346822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.349244 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.349221    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-587790-serving-cert\""
Jul 13 17:42:07.359491 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.359465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:42:07.407533 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.407492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.407716 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.407549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52rp\" (UniqueName: \"kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.407716 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.407634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.508456 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.508368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.508456 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.508417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52rp\" (UniqueName: \"kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.508688 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.508460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.509242 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.509220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.511107 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.511082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.519113 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.519091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52rp\" (UniqueName: \"kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp\") pod \"maas-api-e2e-inf-b-587790-76495d754b-8bmjw\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.659215 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.659170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:07.805628 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:07.805602    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:42:07.808369 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:42:07.808342    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa8e0ef_9637_4d81_877e_75d59b77e4ae.slice/crio-df100a3377f7e5e5324bd3e4b179eb8f81e0733da684239f24ec8d0547204f02 WatchSource:0}: Error finding container df100a3377f7e5e5324bd3e4b179eb8f81e0733da684239f24ec8d0547204f02: Status 404 returned error can't find the container with id df100a3377f7e5e5324bd3e4b179eb8f81e0733da684239f24ec8d0547204f02
Jul 13 17:42:08.235489 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:08.235457    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" event={"ID":"9fa8e0ef-9637-4d81-877e-75d59b77e4ae","Type":"ContainerStarted","Data":"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"}
Jul 13 17:42:08.235866 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:08.235597    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:42:08.235866 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:08.235629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" event={"ID":"9fa8e0ef-9637-4d81-877e-75d59b77e4ae","Type":"ContainerStarted","Data":"df100a3377f7e5e5324bd3e4b179eb8f81e0733da684239f24ec8d0547204f02"}
Jul 13 17:42:08.253672 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:08.253556    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" podStartSLOduration=0.900640142 podStartE2EDuration="1.253535584s" totalImagesPullingTime="352.895442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:42:08.252559548 +0000 UTC m=+2198.011159380" watchObservedRunningTime="2026-07-13 17:42:08.253535584 +0000 UTC m=+2198.012135418"
Jul 13 17:42:14.247971 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:42:14.247936    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:43:22.057682 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.057647    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:43:22.058309 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.057842    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerName="maas-api" containerID="cri-o://ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5" gracePeriod=30
Jul 13 17:43:22.207302 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.207253    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.45:8443/health\": dial tcp 10.134.0.45:8443: connect: connection refused"
Jul 13 17:43:22.309383 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.309312    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:43:22.407097 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.407052    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls\") pod \"a49fd0d4-cc28-4b6d-a051-72fada50636a\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") "
Jul 13 17:43:22.407278 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.407121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c5k2\" (UniqueName: \"kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2\") pod \"a49fd0d4-cc28-4b6d-a051-72fada50636a\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") "
Jul 13 17:43:22.407278 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.407139    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca\") pod \"a49fd0d4-cc28-4b6d-a051-72fada50636a\" (UID: \"a49fd0d4-cc28-4b6d-a051-72fada50636a\") "
Jul 13 17:43:22.407516 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.407490    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a49fd0d4-cc28-4b6d-a051-72fada50636a" (UID: "a49fd0d4-cc28-4b6d-a051-72fada50636a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:43:22.409331 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.409304    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2" (OuterVolumeSpecName: "kube-api-access-9c5k2") pod "a49fd0d4-cc28-4b6d-a051-72fada50636a" (UID: "a49fd0d4-cc28-4b6d-a051-72fada50636a"). InnerVolumeSpecName "kube-api-access-9c5k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:43:22.409331 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.409323    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a49fd0d4-cc28-4b6d-a051-72fada50636a" (UID: "a49fd0d4-cc28-4b6d-a051-72fada50636a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:43:22.508104 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.508072    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49fd0d4-cc28-4b6d-a051-72fada50636a-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:22.508104 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.508098    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c5k2\" (UniqueName: \"kubernetes.io/projected/a49fd0d4-cc28-4b6d-a051-72fada50636a-kube-api-access-9c5k2\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:22.508104 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.508108    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49fd0d4-cc28-4b6d-a051-72fada50636a-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:22.591933 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.591848    2567 generic.go:356] "Generic (PLEG): container finished" podID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerID="ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5" exitCode=0
Jul 13 17:43:22.591933 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.591886    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"
Jul 13 17:43:22.592135 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.591926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" event={"ID":"a49fd0d4-cc28-4b6d-a051-72fada50636a","Type":"ContainerDied","Data":"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"}
Jul 13 17:43:22.592135 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.591984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v" event={"ID":"a49fd0d4-cc28-4b6d-a051-72fada50636a","Type":"ContainerDied","Data":"023e2a6e1fd8887880ddda250fd1a59163c4f7e912eb03d6bbf98ee8c5b28597"}
Jul 13 17:43:22.592135 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.592007    2567 scope.go:117] "RemoveContainer" containerID="ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"
Jul 13 17:43:22.601178 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.601161    2567 scope.go:117] "RemoveContainer" containerID="ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"
Jul 13 17:43:22.601412 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:43:22.601397    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5\": container with ID starting with ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5 not found: ID does not exist" containerID="ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"
Jul 13 17:43:22.601462 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.601419    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5"} err="failed to get container status \"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5\": rpc error: code = NotFound desc = could not find container \"ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5\": container with ID starting with ff1c6a92fd03d404e5d298ba4a3cc39ce84581d006643afea82c29a7156982f5 not found: ID does not exist"
Jul 13 17:43:22.613998 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.613973    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:43:22.616473 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.616454    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a3680-5bcfd8dfc5-bkv4v"]
Jul 13 17:43:22.895625 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:22.895546    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" path="/var/lib/kubelet/pods/a49fd0d4-cc28-4b6d-a051-72fada50636a/volumes"
Jul 13 17:43:48.250922 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.250880    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:43:48.251365 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.251156    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" podUID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" containerName="maas-api" containerID="cri-o://8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7" gracePeriod=30
Jul 13 17:43:48.499476 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.499451    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:43:48.660342 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.660250    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca\") pod \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") "
Jul 13 17:43:48.660342 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.660309    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls\") pod \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") "
Jul 13 17:43:48.660577 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.660417    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w52rp\" (UniqueName: \"kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp\") pod \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\" (UID: \"9fa8e0ef-9637-4d81-877e-75d59b77e4ae\") "
Jul 13 17:43:48.660632 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.660574    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fa8e0ef-9637-4d81-877e-75d59b77e4ae" (UID: "9fa8e0ef-9637-4d81-877e-75d59b77e4ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:43:48.660713 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.660697    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:48.662397 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.662368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fa8e0ef-9637-4d81-877e-75d59b77e4ae" (UID: "9fa8e0ef-9637-4d81-877e-75d59b77e4ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:43:48.662507 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.662479    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp" (OuterVolumeSpecName: "kube-api-access-w52rp") pod "9fa8e0ef-9637-4d81-877e-75d59b77e4ae" (UID: "9fa8e0ef-9637-4d81-877e-75d59b77e4ae"). InnerVolumeSpecName "kube-api-access-w52rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:43:48.719490 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.719458    2567 generic.go:356] "Generic (PLEG): container finished" podID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" containerID="8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7" exitCode=0
Jul 13 17:43:48.719635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.719501    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"
Jul 13 17:43:48.719635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.719540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" event={"ID":"9fa8e0ef-9637-4d81-877e-75d59b77e4ae","Type":"ContainerDied","Data":"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"}
Jul 13 17:43:48.719635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.719598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw" event={"ID":"9fa8e0ef-9637-4d81-877e-75d59b77e4ae","Type":"ContainerDied","Data":"df100a3377f7e5e5324bd3e4b179eb8f81e0733da684239f24ec8d0547204f02"}
Jul 13 17:43:48.719635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.719625    2567 scope.go:117] "RemoveContainer" containerID="8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"
Jul 13 17:43:48.730616 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.730594    2567 scope.go:117] "RemoveContainer" containerID="8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"
Jul 13 17:43:48.730955 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:43:48.730927    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7\": container with ID starting with 8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7 not found: ID does not exist" containerID="8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"
Jul 13 17:43:48.731175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.731148    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7"} err="failed to get container status \"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7\": rpc error: code = NotFound desc = could not find container \"8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7\": container with ID starting with 8a2abbdf898737f4bbf732974dd2850122c115b35e545c0f65aff3c4ca152cf7 not found: ID does not exist"
Jul 13 17:43:48.746293 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.746266    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:43:48.750455 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.750433    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587790-76495d754b-8bmjw"]
Jul 13 17:43:48.761938 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.761913    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w52rp\" (UniqueName: \"kubernetes.io/projected/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-kube-api-access-w52rp\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:48.762040 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.761937    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa8e0ef-9637-4d81-877e-75d59b77e4ae-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:43:48.896287 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:43:48.896247    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" path="/var/lib/kubelet/pods/9fa8e0ef-9637-4d81-877e-75d59b77e4ae/volumes"
Jul 13 17:44:08.061464 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061424    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061845    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" containerName="maas-api"
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061857    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" containerName="maas-api"
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061866    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerName="maas-api"
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061872    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerName="maas-api"
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061941    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa8e0ef-9637-4d81-877e-75d59b77e4ae" containerName="maas-api"
Jul 13 17:44:08.061951 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.061951    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49fd0d4-cc28-4b6d-a051-72fada50636a" containerName="maas-api"
Jul 13 17:44:08.064874 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.064857    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.068313 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.068290    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-edd1bf-serving-cert\""
Jul 13 17:44:08.081375 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.081348    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:08.133111 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.133079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.133286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.133120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.133286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.133228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxvzh\" (UniqueName: \"kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.234204 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.234165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvzh\" (UniqueName: \"kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.234390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.234260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.234390 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.234287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.234999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.234974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.236674 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.236651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.245283 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.245261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxvzh\" (UniqueName: \"kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh\") pod \"maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.375318 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.375216    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:08.513322 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.513296    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:08.515867 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:44:08.515837    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0f0b7b_f35b_40b3_ab9c_4ad224c27290.slice/crio-7198ea2d46f5a04ad1315e5d3613a94efbe3299709618ce8d2e074cd7c5938d4 WatchSource:0}: Error finding container 7198ea2d46f5a04ad1315e5d3613a94efbe3299709618ce8d2e074cd7c5938d4: Status 404 returned error can't find the container with id 7198ea2d46f5a04ad1315e5d3613a94efbe3299709618ce8d2e074cd7c5938d4
Jul 13 17:44:08.517208 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.517187    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:44:08.816809 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:08.816767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" event={"ID":"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290","Type":"ContainerStarted","Data":"7198ea2d46f5a04ad1315e5d3613a94efbe3299709618ce8d2e074cd7c5938d4"}
Jul 13 17:44:09.822981 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:09.822943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" event={"ID":"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290","Type":"ContainerStarted","Data":"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"}
Jul 13 17:44:09.823377 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:09.823009    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:09.844064 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:09.843996    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" podStartSLOduration=1.351519141 podStartE2EDuration="1.843979795s" totalImagesPullingTime="492.460654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:44:09.841862221 +0000 UTC m=+2319.600462054" watchObservedRunningTime="2026-07-13 17:44:09.843979795 +0000 UTC m=+2319.602579718"
Jul 13 17:44:15.833213 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:15.833177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:16.079202 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.079169    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:44:16.082883 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.082864    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.085576 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.085523    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e386c8-serving-cert\""
Jul 13 17:44:16.105985 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.105950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:44:16.209645 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.209612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs8r2\" (UniqueName: \"kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.209859 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.209667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.209859 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.209687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.310760 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.310722    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs8r2\" (UniqueName: \"kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.310944 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.310782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.310944 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.310802    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.311467 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.311445    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.313361 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.313339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.326321 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.326297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs8r2\" (UniqueName: \"kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2\") pod \"maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.394296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.394205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:16.552906 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.552878    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:44:16.555590 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:44:16.555562    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922ec41c_69e9_41f4_80e1_0f966ecea5ed.slice/crio-7b283117cd200bbd39976f1cd1aaf77768cec22c8293767f61698df1a1abe122 WatchSource:0}: Error finding container 7b283117cd200bbd39976f1cd1aaf77768cec22c8293767f61698df1a1abe122: Status 404 returned error can't find the container with id 7b283117cd200bbd39976f1cd1aaf77768cec22c8293767f61698df1a1abe122
Jul 13 17:44:16.857935 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:16.857900    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" event={"ID":"922ec41c-69e9-41f4-80e1-0f966ecea5ed","Type":"ContainerStarted","Data":"7b283117cd200bbd39976f1cd1aaf77768cec22c8293767f61698df1a1abe122"}
Jul 13 17:44:17.863848 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:17.863814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" event={"ID":"922ec41c-69e9-41f4-80e1-0f966ecea5ed","Type":"ContainerStarted","Data":"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"}
Jul 13 17:44:17.864256 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:17.863942    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:17.892449 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:17.892396    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" podStartSLOduration=1.490407667 podStartE2EDuration="1.892378101s" totalImagesPullingTime="401.970434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:44:17.890361574 +0000 UTC m=+2327.648961406" watchObservedRunningTime="2026-07-13 17:44:17.892378101 +0000 UTC m=+2327.650977932"
Jul 13 17:44:23.874788 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:23.874718    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:44:38.695610 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.695578    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:38.696118 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.695790    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" podUID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" containerName="maas-api" containerID="cri-o://068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41" gracePeriod=30
Jul 13 17:44:38.939660 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.939636    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:38.970279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.970195    2567 generic.go:356] "Generic (PLEG): container finished" podID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" containerID="068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41" exitCode=0
Jul 13 17:44:38.970279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.970239    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"
Jul 13 17:44:38.970461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.970276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" event={"ID":"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290","Type":"ContainerDied","Data":"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"}
Jul 13 17:44:38.970461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.970334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc" event={"ID":"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290","Type":"ContainerDied","Data":"7198ea2d46f5a04ad1315e5d3613a94efbe3299709618ce8d2e074cd7c5938d4"}
Jul 13 17:44:38.970461 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.970357    2567 scope.go:117] "RemoveContainer" containerID="068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"
Jul 13 17:44:38.978650 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.978629    2567 scope.go:117] "RemoveContainer" containerID="068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"
Jul 13 17:44:38.978923 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:44:38.978904    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41\": container with ID starting with 068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41 not found: ID does not exist" containerID="068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"
Jul 13 17:44:38.978985 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:38.978933    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41"} err="failed to get container status \"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41\": rpc error: code = NotFound desc = could not find container \"068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41\": container with ID starting with 068bb4bdff6a79ba98bd58477ceb91cd87539cb9a959757784c402e30302ac41 not found: ID does not exist"
Jul 13 17:44:39.027584 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.027555    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca\") pod \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") "
Jul 13 17:44:39.027745 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.027591    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls\") pod \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") "
Jul 13 17:44:39.027745 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.027649    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxvzh\" (UniqueName: \"kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh\") pod \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\" (UID: \"0d0f0b7b-f35b-40b3-ab9c-4ad224c27290\") "
Jul 13 17:44:39.027913 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.027891    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" (UID: "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:44:39.029687 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.029648    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" (UID: "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:44:39.029792 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.029749    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh" (OuterVolumeSpecName: "kube-api-access-xxvzh") pod "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" (UID: "0d0f0b7b-f35b-40b3-ab9c-4ad224c27290"). InnerVolumeSpecName "kube-api-access-xxvzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:44:39.129038 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.128981    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:44:39.129038 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.129034    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:44:39.129038 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.129045    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxvzh\" (UniqueName: \"kubernetes.io/projected/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290-kube-api-access-xxvzh\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:44:39.291729 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.291694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:39.297776 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:39.297750    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edd1bf-9f468b54d-j7ptc"]
Jul 13 17:44:40.895406 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:44:40.895361    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" path="/var/lib/kubelet/pods/0d0f0b7b-f35b-40b3-ab9c-4ad224c27290/volumes"
Jul 13 17:45:05.305599 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.305560    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:45:05.306122 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.305785    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" podUID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" containerName="maas-api" containerID="cri-o://3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc" gracePeriod=30
Jul 13 17:45:05.547024 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.546984    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:45:05.675832 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.675806    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs8r2\" (UniqueName: \"kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2\") pod \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") "
Jul 13 17:45:05.675985 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.675851    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls\") pod \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") "
Jul 13 17:45:05.675985 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.675930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca\") pod \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\" (UID: \"922ec41c-69e9-41f4-80e1-0f966ecea5ed\") "
Jul 13 17:45:05.676362 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.676327    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "922ec41c-69e9-41f4-80e1-0f966ecea5ed" (UID: "922ec41c-69e9-41f4-80e1-0f966ecea5ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:45:05.677939 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.677917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2" (OuterVolumeSpecName: "kube-api-access-hs8r2") pod "922ec41c-69e9-41f4-80e1-0f966ecea5ed" (UID: "922ec41c-69e9-41f4-80e1-0f966ecea5ed"). InnerVolumeSpecName "kube-api-access-hs8r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:45:05.677939 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.677929    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "922ec41c-69e9-41f4-80e1-0f966ecea5ed" (UID: "922ec41c-69e9-41f4-80e1-0f966ecea5ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:45:05.776829 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.776797    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/922ec41c-69e9-41f4-80e1-0f966ecea5ed-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:45:05.776829 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.776823    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs8r2\" (UniqueName: \"kubernetes.io/projected/922ec41c-69e9-41f4-80e1-0f966ecea5ed-kube-api-access-hs8r2\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:45:05.776829 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:05.776833    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/922ec41c-69e9-41f4-80e1-0f966ecea5ed-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:45:06.102563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.102472    2567 generic.go:356] "Generic (PLEG): container finished" podID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" containerID="3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc" exitCode=0
Jul 13 17:45:06.102563 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.102516    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"
Jul 13 17:45:06.102768 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.102564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" event={"ID":"922ec41c-69e9-41f4-80e1-0f966ecea5ed","Type":"ContainerDied","Data":"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"}
Jul 13 17:45:06.102768 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.102609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz" event={"ID":"922ec41c-69e9-41f4-80e1-0f966ecea5ed","Type":"ContainerDied","Data":"7b283117cd200bbd39976f1cd1aaf77768cec22c8293767f61698df1a1abe122"}
Jul 13 17:45:06.102768 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.102631    2567 scope.go:117] "RemoveContainer" containerID="3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"
Jul 13 17:45:06.112868 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.112836    2567 scope.go:117] "RemoveContainer" containerID="3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"
Jul 13 17:45:06.113173 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:45:06.113151    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc\": container with ID starting with 3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc not found: ID does not exist" containerID="3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"
Jul 13 17:45:06.113250 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.113184    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc"} err="failed to get container status \"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc\": rpc error: code = NotFound desc = could not find container \"3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc\": container with ID starting with 3796579c5e8add6d4795631d3eefd4f25990abac18b22929b922c77dd57847cc not found: ID does not exist"
Jul 13 17:45:06.127197 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.127166    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:45:06.131892 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.131865    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e386c8-7b7778c56d-hgkgz"]
Jul 13 17:45:06.894689 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:06.894656    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" path="/var/lib/kubelet/pods/922ec41c-69e9-41f4-80e1-0f966ecea5ed/volumes"
Jul 13 17:45:24.616236 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616197    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:45:24.616634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616619    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" containerName="maas-api"
Jul 13 17:45:24.616634 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616635    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" containerName="maas-api"
Jul 13 17:45:24.616715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616664    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" containerName="maas-api"
Jul 13 17:45:24.616715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616670    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" containerName="maas-api"
Jul 13 17:45:24.616789 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616729    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="922ec41c-69e9-41f4-80e1-0f966ecea5ed" containerName="maas-api"
Jul 13 17:45:24.616789 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.616743    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d0f0b7b-f35b-40b3-ab9c-4ad224c27290" containerName="maas-api"
Jul 13 17:45:24.619861 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.619843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.622098 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.622076    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-714452-serving-cert\""
Jul 13 17:45:24.631205 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.631176    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:45:24.651952 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.651928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.652108 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.651969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7zr\" (UniqueName: \"kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.652108 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.652076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.753530 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.753495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.753530 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.753536    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7zr\" (UniqueName: \"kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.753779 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.753557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.754157 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.754135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.755854 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.755831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.764162 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.764140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7zr\" (UniqueName: \"kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr\") pod \"maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:24.931370 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:24.931343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:25.110759 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:25.110732    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:45:25.112698 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:45:25.112666    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667ee555_a824_4566_9b5a_fcb361370f9f.slice/crio-ff7e8ee54bbbdce945c57a1fafcab04e76fab30e68eb8d5be5a59fd5764ca6b7 WatchSource:0}: Error finding container ff7e8ee54bbbdce945c57a1fafcab04e76fab30e68eb8d5be5a59fd5764ca6b7: Status 404 returned error can't find the container with id ff7e8ee54bbbdce945c57a1fafcab04e76fab30e68eb8d5be5a59fd5764ca6b7
Jul 13 17:45:25.194432 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:25.194343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" event={"ID":"667ee555-a824-4566-9b5a-fcb361370f9f","Type":"ContainerStarted","Data":"ff7e8ee54bbbdce945c57a1fafcab04e76fab30e68eb8d5be5a59fd5764ca6b7"}
Jul 13 17:45:26.200414 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:26.200372    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" event={"ID":"667ee555-a824-4566-9b5a-fcb361370f9f","Type":"ContainerStarted","Data":"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"}
Jul 13 17:45:26.200841 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:26.200438    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:26.219251 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:26.219200    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" podStartSLOduration=1.794930013 podStartE2EDuration="2.219184101s" totalImagesPullingTime="424.254088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:45:26.217777959 +0000 UTC m=+2395.976377791" watchObservedRunningTime="2026-07-13 17:45:26.219184101 +0000 UTC m=+2395.977783932"
Jul 13 17:45:30.965106 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:30.965080    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:45:30.970374 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:30.970354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:45:32.212040 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.212000    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:45:32.602580 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.602490    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:45:32.608288 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.608262    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.610859 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.610838    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-31a784-serving-cert\""
Jul 13 17:45:32.618721 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.618692    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:45:32.727252 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.727205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.727441 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.727283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.727441 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.727308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqhtd\" (UniqueName: \"kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.828117 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.828073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqhtd\" (UniqueName: \"kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.828292 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.828157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.828292 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.828216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.828371 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:45:32.828306    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-serving-cert: secret "maas-api-e2e-shared-b-31a784-serving-cert" not found
Jul 13 17:45:32.828406 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:45:32.828390    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls podName:c45b492a-2712-4411-8dc4-040e628203e8 nodeName:}" failed. No retries permitted until 2026-07-13 17:45:33.328370866 +0000 UTC m=+2403.086970678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls") pod "maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" (UID: "c45b492a-2712-4411-8dc4-040e628203e8") : secret "maas-api-e2e-shared-b-31a784-serving-cert" not found
Jul 13 17:45:32.828808 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.828778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:32.847861 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:32.847826    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqhtd\" (UniqueName: \"kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:33.332120 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:33.332078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:33.334585 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:33.334552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") pod \"maas-api-e2e-shared-b-31a784-d77fdd464-k26bl\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:33.519494 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:33.519455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:33.660382 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:33.660355    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:45:33.662890 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:45:33.662863    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45b492a_2712_4411_8dc4_040e628203e8.slice/crio-715e99c38be4c796b02a8c35570b32c073a0d36884aa8571a3582ac1a20cdc4b WatchSource:0}: Error finding container 715e99c38be4c796b02a8c35570b32c073a0d36884aa8571a3582ac1a20cdc4b: Status 404 returned error can't find the container with id 715e99c38be4c796b02a8c35570b32c073a0d36884aa8571a3582ac1a20cdc4b
Jul 13 17:45:34.240090 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:34.240050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" event={"ID":"c45b492a-2712-4411-8dc4-040e628203e8","Type":"ContainerStarted","Data":"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"}
Jul 13 17:45:34.240407 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:34.240120    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:45:34.240407 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:34.240142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" event={"ID":"c45b492a-2712-4411-8dc4-040e628203e8","Type":"ContainerStarted","Data":"715e99c38be4c796b02a8c35570b32c073a0d36884aa8571a3582ac1a20cdc4b"}
Jul 13 17:45:34.275590 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:34.275533    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" podStartSLOduration=1.863479108 podStartE2EDuration="2.275515032s" totalImagesPullingTime="412.035924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:45:34.274991001 +0000 UTC m=+2404.033590836" watchObservedRunningTime="2026-07-13 17:45:34.275515032 +0000 UTC m=+2404.034114864"
Jul 13 17:45:40.251366 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:45:40.251329    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:48:54.057290 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.057255    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:48:54.060809 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.060791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.063597 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.063578    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-714452\"/\"kube-root-ca.crt\""
Jul 13 17:48:54.063718 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.063602    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-714452\"/\"openshift-service-ca.crt\""
Jul 13 17:48:54.064164 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.064146    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-714452\"/\"default-dockercfg-s6hqf\""
Jul 13 17:48:54.064212 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.064197    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-714452\"/\"sub-test-model-714452-kserve-self-signed-certs\""
Jul 13 17:48:54.072081 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.072055    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:48:54.121711 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.121838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.121838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.121838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.121838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.121994 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.121911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lnlq\" (UniqueName: \"kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223295 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lnlq\" (UniqueName: \"kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223493 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223838 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223904 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223848    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.223904 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.223890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.225800 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.225781    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.226071 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.226055    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.232142 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.232116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lnlq\" (UniqueName: \"kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq\") pod \"sub-test-model-714452-kserve-5db845c5d5-qtl4d\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") " pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.370429 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.370341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:48:54.509345 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:54.509318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:48:54.511290 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:48:54.511267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6a09f1d_5dad_4ae0_bb4f_b4010b29461f.slice/crio-3a15f585791ed216dd5acb93b6c49979c27dffc3c1474c703fd569b2449250d2 WatchSource:0}: Error finding container 3a15f585791ed216dd5acb93b6c49979c27dffc3c1474c703fd569b2449250d2: Status 404 returned error can't find the container with id 3a15f585791ed216dd5acb93b6c49979c27dffc3c1474c703fd569b2449250d2
Jul 13 17:48:55.201583 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:55.201542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" event={"ID":"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f","Type":"ContainerStarted","Data":"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"}
Jul 13 17:48:55.201583 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:55.201586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" event={"ID":"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f","Type":"ContainerStarted","Data":"3a15f585791ed216dd5acb93b6c49979c27dffc3c1474c703fd569b2449250d2"}
Jul 13 17:48:55.219809 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:48:55.219745    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" podStartSLOduration=1.219724463 podStartE2EDuration="1.219724463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:55.219089869 +0000 UTC m=+2604.977689701" watchObservedRunningTime="2026-07-13 17:48:55.219724463 +0000 UTC m=+2604.978324297"
Jul 13 17:49:04.371051 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:49:04.370993    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:49:04.371051 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:49:04.371060    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:49:04.383339 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:49:04.383310    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:49:05.261831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:49:05.261801    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:50:16.688271 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:16.688238    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:50:30.999990 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:30.999921    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:50:31.004673 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:31.004649    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgk76_cb269960-6a56-4e98-8f0b-1ef412a69917/ovn-acl-logging/0.log"
Jul 13 17:50:31.708331 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:31.708265    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" podUID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" containerName="main" containerID="cri-o://0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b" gracePeriod=45
Jul 13 17:50:31.962484 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:31.962422    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:50:32.147904 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.147873    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.147948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.147972    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148039    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lnlq\" (UniqueName: \"kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache\") pod \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\" (UID: \"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f\") "
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148205    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:50:32.148389 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148369    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home" (OuterVolumeSpecName: "home") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:50:32.148695 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148476    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache" (OuterVolumeSpecName: "model-cache") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:50:32.148695 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148570    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-model-cache\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.148695 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148591    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tmp-dir\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.148695 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.148604    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-home\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.150417 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.150389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:50:32.150417 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.150389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm" (OuterVolumeSpecName: "dshm") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:50:32.150619 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.150468    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq" (OuterVolumeSpecName: "kube-api-access-5lnlq") pod "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" (UID: "e6a09f1d-5dad-4ae0-bb4f-b4010b29461f"). InnerVolumeSpecName "kube-api-access-5lnlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:50:32.250068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.249968    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lnlq\" (UniqueName: \"kubernetes.io/projected/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-kube-api-access-5lnlq\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.250068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.249993    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-tls-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.250068 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.250002    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f-dshm\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:50:32.680812 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.680768    2567 generic.go:356] "Generic (PLEG): container finished" podID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" containerID="0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b" exitCode=0
Jul 13 17:50:32.680999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.680817    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"
Jul 13 17:50:32.680999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.680828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" event={"ID":"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f","Type":"ContainerDied","Data":"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"}
Jul 13 17:50:32.680999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.680860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d" event={"ID":"e6a09f1d-5dad-4ae0-bb4f-b4010b29461f","Type":"ContainerDied","Data":"3a15f585791ed216dd5acb93b6c49979c27dffc3c1474c703fd569b2449250d2"}
Jul 13 17:50:32.680999 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.680877    2567 scope.go:117] "RemoveContainer" containerID="0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"
Jul 13 17:50:32.690524 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.690506    2567 scope.go:117] "RemoveContainer" containerID="0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"
Jul 13 17:50:32.690799 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:50:32.690780    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b\": container with ID starting with 0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b not found: ID does not exist" containerID="0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"
Jul 13 17:50:32.690847 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.690809    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b"} err="failed to get container status \"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b\": rpc error: code = NotFound desc = could not find container \"0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b\": container with ID starting with 0f0a73bac941cef6de18b34a42f719237f01f49946345f32b96e824606fb643b not found: ID does not exist"
Jul 13 17:50:32.703582 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.703549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:50:32.711564 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.711528    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-714452/sub-test-model-714452-kserve-5db845c5d5-qtl4d"]
Jul 13 17:50:32.894988 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:32.894955    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" path="/var/lib/kubelet/pods/e6a09f1d-5dad-4ae0-bb4f-b4010b29461f/volumes"
Jul 13 17:50:55.774889 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.774852    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:50:55.775311 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.775246    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" containerName="main"
Jul 13 17:50:55.775311 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.775257    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" containerName="main"
Jul 13 17:50:55.775384 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.775343    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a09f1d-5dad-4ae0-bb4f-b4010b29461f" containerName="main"
Jul 13 17:50:55.778381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.778360    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.781044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.781025    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-31a784\"/\"kube-root-ca.crt\""
Jul 13 17:50:55.781566 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.781544    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-31a784\"/\"default-dockercfg-d2rx8\""
Jul 13 17:50:55.781661 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.781596    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-31a784\"/\"rate-test-model-31a784-kserve-self-signed-certs\""
Jul 13 17:50:55.781661 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.781609    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-31a784\"/\"openshift-service-ca.crt\""
Jul 13 17:50:55.798945 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.798917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:50:55.866419 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.866601 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.866601 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.866601 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnc22\" (UniqueName: \"kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.866601 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.866741 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.866610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968037 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.967921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968207 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnc22\" (UniqueName: \"kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968490 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968550 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.968597 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.968583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.970386 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.970366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.970649 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.970631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:55.975824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:55.975801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnc22\" (UniqueName: \"kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22\") pod \"rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") " pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:56.087946 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:56.087855    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:50:56.223446 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:56.223418    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:50:56.225305 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:50:56.225268    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9ba1c3e_5f9b_4084_82f6_07b35b665c63.slice/crio-0516d3cd9b6c727c1da3de28e641e77448e1eaba4f66900036bb09bbc8ea8212 WatchSource:0}: Error finding container 0516d3cd9b6c727c1da3de28e641e77448e1eaba4f66900036bb09bbc8ea8212: Status 404 returned error can't find the container with id 0516d3cd9b6c727c1da3de28e641e77448e1eaba4f66900036bb09bbc8ea8212
Jul 13 17:50:56.800202 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:56.800162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" event={"ID":"d9ba1c3e-5f9b-4084-82f6-07b35b665c63","Type":"ContainerStarted","Data":"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"}
Jul 13 17:50:56.800202 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:56.800208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" event={"ID":"d9ba1c3e-5f9b-4084-82f6-07b35b665c63","Type":"ContainerStarted","Data":"0516d3cd9b6c727c1da3de28e641e77448e1eaba4f66900036bb09bbc8ea8212"}
Jul 13 17:50:56.827933 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:50:56.827883    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" podStartSLOduration=1.827867095 podStartE2EDuration="1.827867095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:56.825557395 +0000 UTC m=+2726.584157228" watchObservedRunningTime="2026-07-13 17:50:56.827867095 +0000 UTC m=+2726.586466927"
Jul 13 17:51:06.088216 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:06.088179    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:06.088836 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:06.088297    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:06.100895 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:06.100863    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:06.861095 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:06.861063    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:39.960374 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:39.960340    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:51:54.981597 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:54.981522    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" podUID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" containerName="main" containerID="cri-o://dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d" gracePeriod=45
Jul 13 17:51:55.219394 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.219362    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:55.336586 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336488    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336586 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336534    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336586 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336554    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336586 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336582    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336613    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnc22\" (UniqueName: \"kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336672    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs\") pod \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\" (UID: \"d9ba1c3e-5f9b-4084-82f6-07b35b665c63\") "
Jul 13 17:51:55.336926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:51:55.336926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336859    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:51:55.336926 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.336871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home" (OuterVolumeSpecName: "home") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:51:55.337286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.337073    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-home\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:55.337286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.337087    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tmp-dir\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:55.337286 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.337097    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-model-cache\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:55.338949 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.338926    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:51:55.339055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.338927    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22" (OuterVolumeSpecName: "kube-api-access-jnc22") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "kube-api-access-jnc22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:51:55.339055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.338979    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm" (OuterVolumeSpecName: "dshm") pod "d9ba1c3e-5f9b-4084-82f6-07b35b665c63" (UID: "d9ba1c3e-5f9b-4084-82f6-07b35b665c63"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:51:55.437793 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.437749    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-dshm\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:55.437793 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.437786    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnc22\" (UniqueName: \"kubernetes.io/projected/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-kube-api-access-jnc22\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:55.437793 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:55.437799    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba1c3e-5f9b-4084-82f6-07b35b665c63-tls-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:51:56.095715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.095679    2567 generic.go:356] "Generic (PLEG): container finished" podID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" containerID="dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d" exitCode=0
Jul 13 17:51:56.096182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.095722    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"
Jul 13 17:51:56.096182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.095766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" event={"ID":"d9ba1c3e-5f9b-4084-82f6-07b35b665c63","Type":"ContainerDied","Data":"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"}
Jul 13 17:51:56.096182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.095808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv" event={"ID":"d9ba1c3e-5f9b-4084-82f6-07b35b665c63","Type":"ContainerDied","Data":"0516d3cd9b6c727c1da3de28e641e77448e1eaba4f66900036bb09bbc8ea8212"}
Jul 13 17:51:56.096182 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.095825    2567 scope.go:117] "RemoveContainer" containerID="dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"
Jul 13 17:51:56.105306 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.105288    2567 scope.go:117] "RemoveContainer" containerID="dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"
Jul 13 17:51:56.105546 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:51:56.105527    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d\": container with ID starting with dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d not found: ID does not exist" containerID="dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"
Jul 13 17:51:56.105610 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.105559    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d"} err="failed to get container status \"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d\": rpc error: code = NotFound desc = could not find container \"dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d\": container with ID starting with dbfd5fb91b133d92cf3427cb4e724dc61ca75daba519a57f30db2cf9b3ccf45d not found: ID does not exist"
Jul 13 17:51:56.117895 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.117871    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:51:56.121635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.121613    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-31a784/rate-test-model-31a784-kserve-7c8c56bd6c-c5vpv"]
Jul 13 17:51:56.895940 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:51:56.895905    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" path="/var/lib/kubelet/pods/d9ba1c3e-5f9b-4084-82f6-07b35b665c63/volumes"
Jul 13 17:52:09.737039 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:09.736981    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:52:09.737555 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:09.737206    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" podUID="667ee555-a824-4566-9b5a-fcb361370f9f" containerName="maas-api" containerID="cri-o://c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182" gracePeriod=30
Jul 13 17:52:09.985972 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:09.985948    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:52:10.074381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.074299    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf7zr\" (UniqueName: \"kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr\") pod \"667ee555-a824-4566-9b5a-fcb361370f9f\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") "
Jul 13 17:52:10.074381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.074359    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca\") pod \"667ee555-a824-4566-9b5a-fcb361370f9f\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") "
Jul 13 17:52:10.074620 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.074468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls\") pod \"667ee555-a824-4566-9b5a-fcb361370f9f\" (UID: \"667ee555-a824-4566-9b5a-fcb361370f9f\") "
Jul 13 17:52:10.074738 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.074712    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "667ee555-a824-4566-9b5a-fcb361370f9f" (UID: "667ee555-a824-4566-9b5a-fcb361370f9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:52:10.074793 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.074783    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/667ee555-a824-4566-9b5a-fcb361370f9f-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:10.076370 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.076346    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr" (OuterVolumeSpecName: "kube-api-access-bf7zr") pod "667ee555-a824-4566-9b5a-fcb361370f9f" (UID: "667ee555-a824-4566-9b5a-fcb361370f9f"). InnerVolumeSpecName "kube-api-access-bf7zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:52:10.076435 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.076352    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "667ee555-a824-4566-9b5a-fcb361370f9f" (UID: "667ee555-a824-4566-9b5a-fcb361370f9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:52:10.166094 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.166056    2567 generic.go:356] "Generic (PLEG): container finished" podID="667ee555-a824-4566-9b5a-fcb361370f9f" containerID="c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182" exitCode=0
Jul 13 17:52:10.166265 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.166109    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"
Jul 13 17:52:10.166265 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.166139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" event={"ID":"667ee555-a824-4566-9b5a-fcb361370f9f","Type":"ContainerDied","Data":"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"}
Jul 13 17:52:10.166265 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.166194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d" event={"ID":"667ee555-a824-4566-9b5a-fcb361370f9f","Type":"ContainerDied","Data":"ff7e8ee54bbbdce945c57a1fafcab04e76fab30e68eb8d5be5a59fd5764ca6b7"}
Jul 13 17:52:10.166265 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.166217    2567 scope.go:117] "RemoveContainer" containerID="c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"
Jul 13 17:52:10.175381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.175359    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf7zr\" (UniqueName: \"kubernetes.io/projected/667ee555-a824-4566-9b5a-fcb361370f9f-kube-api-access-bf7zr\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:10.175381 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.175381    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/667ee555-a824-4566-9b5a-fcb361370f9f-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:10.175947 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.175929    2567 scope.go:117] "RemoveContainer" containerID="c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"
Jul 13 17:52:10.176213 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:52:10.176193    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182\": container with ID starting with c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182 not found: ID does not exist" containerID="c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"
Jul 13 17:52:10.176269 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.176220    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182"} err="failed to get container status \"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182\": rpc error: code = NotFound desc = could not find container \"c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182\": container with ID starting with c6f9401dd04e3b595f74c0982dc9302415a3b3fea6d9959680416f3357ad3182 not found: ID does not exist"
Jul 13 17:52:10.187822 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.187801    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:52:10.194283 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.194261    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-714452-7bc4499bcb-v7k6d"]
Jul 13 17:52:10.894573 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:10.894540    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667ee555-a824-4566-9b5a-fcb361370f9f" path="/var/lib/kubelet/pods/667ee555-a824-4566-9b5a-fcb361370f9f/volumes"
Jul 13 17:52:35.895994 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:35.895955    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:52:35.896543 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:35.896232    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" podUID="c45b492a-2712-4411-8dc4-040e628203e8" containerName="maas-api" containerID="cri-o://0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1" gracePeriod=30
Jul 13 17:52:36.134700 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.134670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:52:36.290785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.290745    2567 generic.go:356] "Generic (PLEG): container finished" podID="c45b492a-2712-4411-8dc4-040e628203e8" containerID="0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1" exitCode=0
Jul 13 17:52:36.290964 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.290795    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"
Jul 13 17:52:36.290964 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.290820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" event={"ID":"c45b492a-2712-4411-8dc4-040e628203e8","Type":"ContainerDied","Data":"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"}
Jul 13 17:52:36.290964 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.290873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl" event={"ID":"c45b492a-2712-4411-8dc4-040e628203e8","Type":"ContainerDied","Data":"715e99c38be4c796b02a8c35570b32c073a0d36884aa8571a3582ac1a20cdc4b"}
Jul 13 17:52:36.290964 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.290904    2567 scope.go:117] "RemoveContainer" containerID="0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"
Jul 13 17:52:36.299649 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.299628    2567 scope.go:117] "RemoveContainer" containerID="0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"
Jul 13 17:52:36.299989 ip-10-0-138-241 kubenswrapper[2567]: E0713 17:52:36.299970    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1\": container with ID starting with 0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1 not found: ID does not exist" containerID="0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"
Jul 13 17:52:36.300062 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.299998    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1"} err="failed to get container status \"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1\": rpc error: code = NotFound desc = could not find container \"0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1\": container with ID starting with 0717c9cb5a98b039f1430fa8524aa111c23d9ff02df5f0f02b1f4673e42e3fd1 not found: ID does not exist"
Jul 13 17:52:36.320392 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.320362    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqhtd\" (UniqueName: \"kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd\") pod \"c45b492a-2712-4411-8dc4-040e628203e8\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") "
Jul 13 17:52:36.320497 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.320413    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca\") pod \"c45b492a-2712-4411-8dc4-040e628203e8\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") "
Jul 13 17:52:36.320497 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.320449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") pod \"c45b492a-2712-4411-8dc4-040e628203e8\" (UID: \"c45b492a-2712-4411-8dc4-040e628203e8\") "
Jul 13 17:52:36.320845 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.320820    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c45b492a-2712-4411-8dc4-040e628203e8" (UID: "c45b492a-2712-4411-8dc4-040e628203e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:52:36.322546 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.322513    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd" (OuterVolumeSpecName: "kube-api-access-pqhtd") pod "c45b492a-2712-4411-8dc4-040e628203e8" (UID: "c45b492a-2712-4411-8dc4-040e628203e8"). InnerVolumeSpecName "kube-api-access-pqhtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:52:36.322546 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.322528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c45b492a-2712-4411-8dc4-040e628203e8" (UID: "c45b492a-2712-4411-8dc4-040e628203e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:52:36.421604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.421553    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqhtd\" (UniqueName: \"kubernetes.io/projected/c45b492a-2712-4411-8dc4-040e628203e8-kube-api-access-pqhtd\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:36.421604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.421597    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45b492a-2712-4411-8dc4-040e628203e8-openshift-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:36.421604 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.421608    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45b492a-2712-4411-8dc4-040e628203e8-maas-api-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 13 17:52:36.627579 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.627542    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:52:36.633397 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.633369    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-31a784-d77fdd464-k26bl"]
Jul 13 17:52:36.895004 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:36.894925    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45b492a-2712-4411-8dc4-040e628203e8" path="/var/lib/kubelet/pods/c45b492a-2712-4411-8dc4-040e628203e8/volumes"
Jul 13 17:52:52.015715 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:52.015682    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78c9d4f644-8l5gv_86f8f6ca-e828-4855-98c3-b2f491b708f0/authorino/0.log"
Jul 13 17:52:57.989314 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:57.989288    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dfb6c5f74-twtpp_10e529f0-df8d-4c77-a48b-2bad00bf64cf/copy-manifests/0.log"
Jul 13 17:52:57.996568 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:57.996545    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dfb6c5f74-twtpp_10e529f0-df8d-4c77-a48b-2bad00bf64cf/manager/0.log"
Jul 13 17:52:58.366302 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:52:58.366222    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5874c489-tscjh_80e5f489-ea40-491f-8f5c-7338db374396/maas-api/0.log"
Jul 13 17:53:00.010993 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:00.010960    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kcw9w_52393e83-64bb-4b25-a0ee-c90491944bc1/postgres/0.log"
Jul 13 17:53:01.405259 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:01.405229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78c9d4f644-8l5gv_86f8f6ca-e828-4855-98c3-b2f491b708f0/authorino/0.log"
Jul 13 17:53:01.791966 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:01.791938    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4m72d_5f0f5345-99d3-48d1-81aa-b27fec00bcfd/kuadrant-console-plugin/0.log"
Jul 13 17:53:03.004847 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:03.004821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746dfd5849-jjv9b_5311167d-f8f2-4614-a0d6-241fb02364fb/kube-auth-proxy/0.log"
Jul 13 17:53:03.247361 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:03.247327    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-24nct_00b15f2c-bdd2-43d5-9348-d15a39295e5d/payload-pre-processing/0.log"
Jul 13 17:53:03.961591 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:03.961551    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-s9gpf_ce28563e-42f6-4748-8903-6f72b78a8bf7/main/0.log"
Jul 13 17:53:04.081576 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:04.081545    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4xrrj_03488a88-a2bb-43da-9b13-299860e981a3/main/0.log"
Jul 13 17:53:04.215244 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:04.215162    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpkglr_74089b23-f138-4cf4-9525-2de4441dc0a4/main/0.log"
Jul 13 17:53:11.615035 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:11.614989    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tplfd_80f9a1c4-9968-440b-bd35-d3f5b4bc9fe1/global-pull-secret-syncer/0.log"
Jul 13 17:53:11.735863 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:11.735811    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qftlq_d2ffae37-af09-4fc7-bbe5-290183f73844/konnectivity-agent/0.log"
Jul 13 17:53:11.806458 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:11.806419    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-241.ec2.internal_3f4eaa5d8f91e8f1be5b963701a60942/haproxy/0.log"
Jul 13 17:53:16.827446 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:16.827391    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78c9d4f644-8l5gv_86f8f6ca-e828-4855-98c3-b2f491b708f0/authorino/0.log"
Jul 13 17:53:16.915115 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:16.915087    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4m72d_5f0f5345-99d3-48d1-81aa-b27fec00bcfd/kuadrant-console-plugin/0.log"
Jul 13 17:53:18.801094 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.801063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/alertmanager/0.log"
Jul 13 17:53:18.831279 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.831247    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/config-reloader/0.log"
Jul 13 17:53:18.853096 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.853055    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/kube-rbac-proxy-web/0.log"
Jul 13 17:53:18.874408 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.874387    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/kube-rbac-proxy/0.log"
Jul 13 17:53:18.900808 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.900765    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/kube-rbac-proxy-metric/0.log"
Jul 13 17:53:18.924881 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.924846    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/prom-label-proxy/0.log"
Jul 13 17:53:18.963766 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:18.963742    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7a07364-1fa3-404d-b977-8b91f6166b55/init-config-reloader/0.log"
Jul 13 17:53:19.055393 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.055298    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8ncsl_59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb/kube-state-metrics/0.log"
Jul 13 17:53:19.077405 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.077360    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8ncsl_59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb/kube-rbac-proxy-main/0.log"
Jul 13 17:53:19.100558 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.100532    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8ncsl_59048ed2-c5c4-43dc-bfc1-e04ef5a80bdb/kube-rbac-proxy-self/0.log"
Jul 13 17:53:19.127852 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.127828    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f78f94c66-r4vxd_ac4376f2-c6ca-463a-9b2f-3c5caaabe7db/metrics-server/0.log"
Jul 13 17:53:19.155320 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.155293    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-7vkpr_7040f59f-b74f-4f3e-8686-94149aba2a3f/monitoring-plugin/0.log"
Jul 13 17:53:19.181824 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.181801    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-66nmm_a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5/node-exporter/0.log"
Jul 13 17:53:19.203036 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.202998    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-66nmm_a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5/kube-rbac-proxy/0.log"
Jul 13 17:53:19.228044 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.228006    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-66nmm_a8d0d8ee-5b4f-4e7f-9c5d-179086b745c5/init-textfile/0.log"
Jul 13 17:53:19.424885 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.424804    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6wwg5_6b511752-719b-433e-bb6f-6f924a880286/kube-rbac-proxy-main/0.log"
Jul 13 17:53:19.446821 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.446793    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6wwg5_6b511752-719b-433e-bb6f-6f924a880286/kube-rbac-proxy-self/0.log"
Jul 13 17:53:19.470088 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.470061    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6wwg5_6b511752-719b-433e-bb6f-6f924a880286/openshift-state-metrics/0.log"
Jul 13 17:53:19.511657 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.511637    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/prometheus/0.log"
Jul 13 17:53:19.536162 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.536138    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/config-reloader/0.log"
Jul 13 17:53:19.557917 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.557897    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/thanos-sidecar/0.log"
Jul 13 17:53:19.585833 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.585783    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/kube-rbac-proxy-web/0.log"
Jul 13 17:53:19.610730 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.610710    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/kube-rbac-proxy/0.log"
Jul 13 17:53:19.636635 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.636613    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/kube-rbac-proxy-thanos/0.log"
Jul 13 17:53:19.664296 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.664273    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8bbe0bf-3761-4950-bcf6-c09b7c369213/init-config-reloader/0.log"
Jul 13 17:53:19.877377 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.877347    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/thanos-query/0.log"
Jul 13 17:53:19.902783 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.902757    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/kube-rbac-proxy-web/0.log"
Jul 13 17:53:19.929278 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.929255    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/kube-rbac-proxy/0.log"
Jul 13 17:53:19.951426 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.951403    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/prom-label-proxy/0.log"
Jul 13 17:53:19.970843 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.970817    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/kube-rbac-proxy-rules/0.log"
Jul 13 17:53:19.993920 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:19.993829    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77d6dd6c99-b6vhm_367a6524-936d-420f-ae2a-c5593dafe853/kube-rbac-proxy-metrics/0.log"
Jul 13 17:53:21.790785 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.790747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"]
Jul 13 17:53:21.791175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791144    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45b492a-2712-4411-8dc4-040e628203e8" containerName="maas-api"
Jul 13 17:53:21.791175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791155    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45b492a-2712-4411-8dc4-040e628203e8" containerName="maas-api"
Jul 13 17:53:21.791175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791168    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" containerName="main"
Jul 13 17:53:21.791175 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791174    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" containerName="main"
Jul 13 17:53:21.791316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791187    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667ee555-a824-4566-9b5a-fcb361370f9f" containerName="maas-api"
Jul 13 17:53:21.791316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791193    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="667ee555-a824-4566-9b5a-fcb361370f9f" containerName="maas-api"
Jul 13 17:53:21.791316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791263    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ba1c3e-5f9b-4084-82f6-07b35b665c63" containerName="main"
Jul 13 17:53:21.791316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791271    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="667ee555-a824-4566-9b5a-fcb361370f9f" containerName="maas-api"
Jul 13 17:53:21.791316 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.791279    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45b492a-2712-4411-8dc4-040e628203e8" containerName="maas-api"
Jul 13 17:53:21.794422 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.794400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:21.796455 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.796430    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rq8n6\"/\"kube-root-ca.crt\""
Jul 13 17:53:21.796942 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.796918    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rq8n6\"/\"openshift-service-ca.crt\""
Jul 13 17:53:21.797063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.796952    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rq8n6\"/\"default-dockercfg-2c2l5\""
Jul 13 17:53:21.803166 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.803142    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"]
Jul 13 17:53:21.935419 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.935386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-proc\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:21.935419 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.935424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8x8l\" (UniqueName: \"kubernetes.io/projected/849622ca-94dc-4b32-936a-9878a03fe7ef-kube-api-access-m8x8l\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:21.935644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.935533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-podres\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:21.935644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.935564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-lib-modules\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:21.935644 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:21.935611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-sys\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.036603 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-lib-modules\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.036831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-sys\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.036831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036725    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-sys\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.036831 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-lib-modules\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.037063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-proc\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.037063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8x8l\" (UniqueName: \"kubernetes.io/projected/849622ca-94dc-4b32-936a-9878a03fe7ef-kube-api-access-m8x8l\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.037063 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.036938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-proc\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.037230 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.037072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-podres\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.037230 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.037180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/849622ca-94dc-4b32-936a-9878a03fe7ef-podres\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.044791 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.044726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8x8l\" (UniqueName: \"kubernetes.io/projected/849622ca-94dc-4b32-936a-9878a03fe7ef-kube-api-access-m8x8l\") pod \"perf-node-gather-daemonset-jnnc5\" (UID: \"849622ca-94dc-4b32-936a-9878a03fe7ef\") " pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.105706 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.105659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.237500 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.237470    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"]
Jul 13 17:53:22.239917 ip-10-0-138-241 kubenswrapper[2567]: W0713 17:53:22.239889    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod849622ca_94dc_4b32_936a_9878a03fe7ef.slice/crio-2e65f0229bc4f9dffa5274491238467809bcf0c91d850b8355ad4b55cbacff58 WatchSource:0}: Error finding container 2e65f0229bc4f9dffa5274491238467809bcf0c91d850b8355ad4b55cbacff58: Status 404 returned error can't find the container with id 2e65f0229bc4f9dffa5274491238467809bcf0c91d850b8355ad4b55cbacff58
Jul 13 17:53:22.512893 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.512855    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5" event={"ID":"849622ca-94dc-4b32-936a-9878a03fe7ef","Type":"ContainerStarted","Data":"8a951bb5b2be393e360ea1aeb40487357449a9c1359bee2cdf5bd668dbc53691"}
Jul 13 17:53:22.513106 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.512908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5" event={"ID":"849622ca-94dc-4b32-936a-9878a03fe7ef","Type":"ContainerStarted","Data":"2e65f0229bc4f9dffa5274491238467809bcf0c91d850b8355ad4b55cbacff58"}
Jul 13 17:53:22.513106 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.512995    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:22.528808 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:22.528745    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5" podStartSLOduration=1.528730164 podStartE2EDuration="1.528730164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:53:22.526373875 +0000 UTC m=+2872.284973707" watchObservedRunningTime="2026-07-13 17:53:22.528730164 +0000 UTC m=+2872.287330037"
Jul 13 17:53:24.084680 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:24.084653    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-946mn_8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af/dns/0.log"
Jul 13 17:53:24.106602 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:24.106576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-946mn_8cdc95cb-7f0d-4d37-9f1a-e6de75efe6af/kube-rbac-proxy/0.log"
Jul 13 17:53:24.254986 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:24.254958    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfr4b_a49cd7a0-4e03-4c00-96aa-3b2d491389b1/dns-node-resolver/0.log"
Jul 13 17:53:24.816274 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:24.816239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkvxj_121406d1-00ed-49e7-8a20-34bc4f265c1d/node-ca/0.log"
Jul 13 17:53:25.918100 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:25.918072    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746dfd5849-jjv9b_5311167d-f8f2-4614-a0d6-241fb02364fb/kube-auth-proxy/0.log"
Jul 13 17:53:26.011702 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:26.011669    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-24nct_00b15f2c-bdd2-43d5-9348-d15a39295e5d/payload-pre-processing/0.log"
Jul 13 17:53:26.778100 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:26.778075    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t59nw_32017910-651c-485f-b4e1-ca6f603185ed/serve-healthcheck-canary/0.log"
Jul 13 17:53:27.245515 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:27.245485    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmwnm_cab9ef09-1979-4872-94dc-916777fb56c6/kube-rbac-proxy/0.log"
Jul 13 17:53:27.266214 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:27.266175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmwnm_cab9ef09-1979-4872-94dc-916777fb56c6/exporter/0.log"
Jul 13 17:53:27.289373 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:27.289347    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmwnm_cab9ef09-1979-4872-94dc-916777fb56c6/extractor/0.log"
Jul 13 17:53:28.528134 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:28.528106    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rq8n6/perf-node-gather-daemonset-jnnc5"
Jul 13 17:53:30.099352 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:30.099323    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dfb6c5f74-twtpp_10e529f0-df8d-4c77-a48b-2bad00bf64cf/manager/0.log"
Jul 13 17:53:30.123472 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:30.123441    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dfb6c5f74-twtpp_10e529f0-df8d-4c77-a48b-2bad00bf64cf/copy-manifests/0.log"
Jul 13 17:53:31.564095 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:31.564063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f6649c567-k4ffv_c54fd267-0742-45c9-acd1-6442dcc44efc/manager/0.log"
Jul 13 17:53:31.618465 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:31.618437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fv9fp_9415432c-01fd-453b-a885-d1fff2c8dc61/openshift-lws-operator/0.log"
Jul 13 17:53:32.450522 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:32.450492    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746dfd5849-jjv9b_5311167d-f8f2-4614-a0d6-241fb02364fb/kube-auth-proxy/0.log"
Jul 13 17:53:32.535722 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:32.535695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-24nct_00b15f2c-bdd2-43d5-9348-d15a39295e5d/payload-pre-processing/0.log"
Jul 13 17:53:33.973134 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:33.973104    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746dfd5849-jjv9b_5311167d-f8f2-4614-a0d6-241fb02364fb/kube-auth-proxy/0.log"
Jul 13 17:53:34.063333 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:34.063304    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-24nct_00b15f2c-bdd2-43d5-9348-d15a39295e5d/payload-pre-processing/0.log"
Jul 13 17:53:38.042854 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.042823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/kube-multus-additional-cni-plugins/0.log"
Jul 13 17:53:38.064055 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.064000    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/egress-router-binary-copy/0.log"
Jul 13 17:53:38.085469 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.085447    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/cni-plugins/0.log"
Jul 13 17:53:38.115997 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.115967    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/bond-cni-plugin/0.log"
Jul 13 17:53:38.145097 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.145067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/routeoverride-cni/0.log"
Jul 13 17:53:38.165594 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.165567    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/whereabouts-cni-bincopy/0.log"
Jul 13 17:53:38.187290 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.187266    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fr9qd_093223d9-cfe3-44b7-adae-0046482639a6/whereabouts-cni/0.log"
Jul 13 17:53:38.567086 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.567037    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tdzgt_50619687-a54b-4fcb-a9b1-d415546bf4e4/kube-multus/0.log"
Jul 13 17:53:38.588297 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.588267    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48lrl_7a08b963-67ee-4331-9f33-939660d0e2e6/network-metrics-daemon/0.log"
Jul 13 17:53:38.607214 ip-10-0-138-241 kubenswrapper[2567]: I0713 17:53:38.607189    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48lrl_7a08b963-67ee-4331-9f33-939660d0e2e6/kube-rbac-proxy/0.log"