Jul 08 16:01:38.363864 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 16:01:38.363878 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 16:01:38.363888 ip-10-0-138-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 16:01:38.364241 ip-10-0-138-121 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 16:01:49.698685 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 16:01:49.698703 ip-10-0-138-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e7c9b53bc3514a0eb3de8cf5f01aa562 --
Jul 08 16:03:51.718155 ip-10-0-138-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 16:03:52.231831 ip-10-0-138-121 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:03:52.231831 ip-10-0-138-121 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 16:03:52.231831 ip-10-0-138-121 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:03:52.231831 ip-10-0-138-121 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 16:03:52.231831 ip-10-0-138-121 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:03:52.234461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.234362    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 16:03:52.240093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240070    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.240093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240088    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.240093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240094    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.240093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240099    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240104    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240108    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240112    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240119    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240125    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240132    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240138    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240143    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240147    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240152    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240155    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240160    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240164    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240176    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240181    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240185    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240190    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240195    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.240336 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240199    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240203    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240208    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240212    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240217    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240221    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240226    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240230    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240234    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240239    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240244    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240249    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240253    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240258    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240262    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240268    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240273    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240278    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240283    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240287    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.241154 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240292    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240296    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240301    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240305    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240314    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240319    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240325    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240330    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240335    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240345    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240350    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240354    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240359    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240364    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240368    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240373    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240377    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240382    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240386    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.241971 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240391    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240396    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240401    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240405    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240410    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240414    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240419    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240423    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240429    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240433    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240438    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240443    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240447    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240451    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240456    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240462    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240466    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240474    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240478    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240483    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.242511 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240488    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240492    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240497    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240502    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240507    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240511    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240515    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240520    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240524    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240529    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240533    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240538    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240542    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240547    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240552    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240557    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240561    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.240566    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242507    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.243055 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242520    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242524    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242527    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242530    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242534    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242539    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242544    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242547    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242550    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242553    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242556    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242560    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242562    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242565    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242568    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242571    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242574    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242577    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242579    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.243581 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242582    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242585    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242587    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242590    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242593    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242596    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242604    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242606    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242609    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242612    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242616    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242620    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242624    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242627    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242630    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242633    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242636    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242639    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242642    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.244125 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242644    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242647    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242650    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242652    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242655    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242658    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242660    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242663    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242666    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242668    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242671    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242674    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242676    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242679    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242684    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242688    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242691    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242694    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242697    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242700    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.244652 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242703    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242706    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242709    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242712    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242715    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242718    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242722    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242725    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242728    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242730    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242734    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242737    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242740    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242743    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242746    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242749    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242751    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242759    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242762    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242765    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.245198 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242767    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242770    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242773    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242776    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242779    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242782    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242785    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242787    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242790    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242793    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242795    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242798    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242804    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242807    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242809    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242812    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242815    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242828    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.245718 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.242832    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243284    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243291    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243295    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243298    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243301    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243304    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243307    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243310    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243313    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243318    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243321    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243324    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243327    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243331    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243334    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243337    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243340    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243344    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.246237 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243346    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243349    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243352    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243355    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243358    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243360    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243363    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243366    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243368    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243371    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243374    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243377    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243380    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243383    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243386    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243406    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243410    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243414    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243417    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243420    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.246720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243424    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243427    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243430    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243433    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243435    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243438    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243441    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243444    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243446    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243449    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243452    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243455    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243458    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243461    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243463    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243466    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243469    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243472    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243475    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243478    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.247263 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243481    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243484    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243487    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243490    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243493    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243495    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243499    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243502    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243504    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243507    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243510    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243512    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243515    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243517    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243520    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243523    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243526    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243528    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243531    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243534    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.247777 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243536    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243539    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243541    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243544    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243547    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243550    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243552    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243555    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243558    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243561    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243564    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243566    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243569    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243571    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243574    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243577    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243580    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243584    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243588    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243591    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.248304 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.243594    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243662    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243670    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243677    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243690    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243695    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243698    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243703    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243707    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243710    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243713    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243717    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243720    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243724    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243727    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243730    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243733    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243737    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243740    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243746    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243749    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243753    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243756    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243760    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 16:03:52.248824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243763    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243766    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243770    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243774    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243777    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243780    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243783    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243787    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243790    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243794    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243798    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243801    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243804    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243807    2562 flags.go:64] FLAG: --enable-server="true"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243810    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243814    2562 flags.go:64] FLAG: --event-burst="100"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243817    2562 flags.go:64] FLAG: --event-qps="50"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243821    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243824    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243827    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243831    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243834    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243837    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243840    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243843    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 16:03:52.249452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243846    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243850    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243853    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243859    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243863    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243866    2562 flags.go:64] FLAG: --feature-gates=""
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243870    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243873    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243876    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243880    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243883    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243886    2562 flags.go:64] FLAG: --help="false"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243889    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243892    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243895    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243898    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243902    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243905    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243908    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243911    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243914    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243917    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243920    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243923    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 16:03:52.250168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243926    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243944    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243947    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243950    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243953    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243956    2562 flags.go:64] FLAG: --lock-file=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243960    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243963    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243968    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243974    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243978    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243983    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243986    2562 flags.go:64] FLAG: --logging-format="text"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243989    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243992    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243995    2562 flags.go:64] FLAG: --manifest-url=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.243999    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244003    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244007    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244011    2562 flags.go:64] FLAG: --max-pods="110"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244014    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244018    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244021    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244024    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244027    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 16:03:52.251233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244030    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244033    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244041    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244044    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244047    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244050    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244054    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244060    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244063    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244067    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244070    2562 flags.go:64] FLAG: --port="10250"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244073    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244076    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f641815bd9277ec6"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244080    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244083    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244086    2562 flags.go:64] FLAG: --register-node="true"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244091    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244094    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244100    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244103    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244106    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244110    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244113    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244116    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244119    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 16:03:52.252390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244122    2562 flags.go:64] FLAG: --runonce="false"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244126    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244129    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244132    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244136    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244139    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244142    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244146    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244149    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244152    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244155    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244158    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244161    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244165    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244168    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244171    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244176    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244180    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244182    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244188    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244191    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244194    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244197    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244202    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244206    2562 flags.go:64] FLAG: --v="2"
Jul 08 16:03:52.253273 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244216    2562 flags.go:64] FLAG: --version="false"
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244224    2562 flags.go:64] FLAG: --vmodule=""
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244228    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244231    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244354    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244359    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244362    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244365    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244368    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244371    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244374    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244376    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244379    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244382    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244386    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244388    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244391    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244394    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244397    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244400    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244403    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.254220 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244406    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244408    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244411    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244414    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244417    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244419    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244422    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244425    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244428    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244432    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244435    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244440    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244443    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244448    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244452    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244456    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244459    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244462    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244465    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244468    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.255202 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244470    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244473    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244476    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244479    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244482    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244484    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244487    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244490    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244492    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244495    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244498    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244501    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244504    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244506    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244510    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244512    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244515    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244518    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244521    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.255873 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244524    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244526    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244531    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244533    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244538    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244541    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244544    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244547    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244550    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244553    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244555    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244558    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244562    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244566    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244570    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244573    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244576    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244579    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244582    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.256742 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244585    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244588    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244591    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244593    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244596    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244599    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244601    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244604    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244607    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244609    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244612    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244615    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244618    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244620    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244623    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244628    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244631    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244635    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244638    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244641    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.257604 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244643    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244647    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244650    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.244652    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.244659    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.252763    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.252781    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.253775    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.253788    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253905    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253914    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253920    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253926    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253931    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253936    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.258251 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253942    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253946    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253950    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253956    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253960    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253965    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253969    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253973    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253977    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253981    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253986    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253990    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253994    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.253999    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254003    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254008    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254012    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254016    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254025    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254030    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.258776 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254034    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254039    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254043    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254049    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254053    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254057    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254061    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254065    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254070    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254074    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254079    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254085    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254092    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254097    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254102    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254107    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254112    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254117    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254122    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.259347 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254127    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254132    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254136    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254141    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254146    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254150    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254155    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254160    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254165    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254169    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254174    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254178    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254184    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254190    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254195    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254200    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254204    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254211    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254218    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.259839 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254224    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254229    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254233    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254238    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254243    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254248    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254252    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254257    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254261    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254266    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254270    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254275    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254280    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254284    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254289    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254293    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254299    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254303    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254308    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254312    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.260363 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254317    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254322    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254326    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254331    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254336    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254340    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254345    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254350    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254355    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254360    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254365    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254369    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254373    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254378    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254382    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.260953 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.254391    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254586    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254594    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254599    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254605    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254610    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254615    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254620    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254625    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254630    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254634    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254638    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254643    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254647    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254652    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254657    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254662    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254666    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254671    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254675    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:03:52.261354 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254680    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254684    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254688    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254693    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254698    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254703    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254711    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254716    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254721    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254726    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254731    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254736    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254741    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254745    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254750    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254754    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254759    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254767    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254772    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:03:52.261982 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254776    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254782    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254786    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254791    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254796    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254800    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254805    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254810    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254814    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254819    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254823    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254828    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254834    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254839    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254844    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254848    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254853    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254859    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254863    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254868    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:03:52.262543 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254872    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254877    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254882    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254886    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254891    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254895    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254900    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254905    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254909    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254916    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254921    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254927    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254931    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254950    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254955    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254959    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254964    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254968    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254972    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:03:52.263093 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254977    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254981    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254989    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254994    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.254999    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255004    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255008    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255013    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255017    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255022    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255026    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255031    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255036    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255041    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255046    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255050    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255055    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255059    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255064    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255068    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:03:52.263606 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:52.255072    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.255081    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.255260    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.258330    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.260482    2562 server.go:1019] "Starting client certificate rotation"
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.260597    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.260670    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:03:52.264482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.264283    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:03:52.266976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.266960    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:03:52.279452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.279435    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 08 16:03:52.283128 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.283113    2562 log.go:25] "Validated CRI v1 image API"
Jul 08 16:03:52.284792 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.284775    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 16:03:52.288130 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.288107    2562 fs.go:135] Filesystem UUIDs: map[678fb36b-4daf-41e2-b141-cb0380620321:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c9f07ea4-693f-46be-bbb6-2e6d4d270ef3:/dev/nvme0n1p3]
Jul 08 16:03:52.288215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.288129    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 16:03:52.294318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.294192    2562 manager.go:216] Machine: {Timestamp:2026-07-08 16:03:52.292130845 +0000 UTC m=+0.429655786 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3071639 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dfa51909ff7120b280a30b343f2ff SystemUUID:ec2dfa51-909f-f712-0b28-0a30b343f2ff BootID:e7c9b53b-c351-4a0e-b3de-8cf5f01aa562 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:c2:94:de:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:c2:94:de:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:02:3c:6c:d5:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 16:03:52.294318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.294304    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 16:03:52.294491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.294423    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 16:03:52.298971 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.298941    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 16:03:52.299114 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.298973    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 16:03:52.299879 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.299869    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 16:03:52.299921 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.299883    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 16:03:52.299921 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.299890    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:03:52.300667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.300655    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:03:52.301172 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.301156    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:03:52.302339 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.302328    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 16:03:52.305462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305449    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:03:52.305616 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305606    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 16:03:52.305653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305647    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 16:03:52.305683 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305666    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 16:03:52.305683 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305681    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 16:03:52.305781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305696    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 08 16:03:52.305781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.305711    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 16:03:52.306124 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.306112    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:03:52.306217 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.306132    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:03:52.308910 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.308891    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 16:03:52.311129 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.311114    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 16:03:52.311216 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.311155    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 16:03:52.312490 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312476    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312499    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312509    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312518    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312531    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312541    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312554    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 16:03:52.312564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312563    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 16:03:52.312802 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312573    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 16:03:52.312802 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312583    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 16:03:52.312802 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312598    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 16:03:52.312802 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.312607    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 16:03:52.314411 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.314398    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 16:03:52.314468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.314415    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 16:03:52.316263 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.316240    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 16:03:52.316374 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.316274    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 16:03:52.316374 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.316274    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 16:03:52.317840 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.317823    2562 server.go:1268] "Started kubelet"
Jul 08 16:03:52.317919 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.317878    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 16:03:52.317983 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.317902    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 16:03:52.317983 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.317970    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 16:03:52.318760 ip-10-0-138-121 systemd[1]: Started Kubernetes Kubelet.
Jul 08 16:03:52.322432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.322406    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 16:03:52.323091 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.323066    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdwbc"
Jul 08 16:03:52.323827 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.323813    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 16:03:52.324236 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.324204    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 16:03:52.328976 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.327373    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-121.ec2.internal.18c05c05c6c03bcd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-121.ec2.internal,UID:ip-10-0-138-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-121.ec2.internal,},FirstTimestamp:2026-07-08 16:03:52.317795277 +0000 UTC m=+0.455320218,LastTimestamp:2026-07-08 16:03:52.317795277 +0000 UTC m=+0.455320218,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-121.ec2.internal,}"
Jul 08 16:03:52.329878 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.329845    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 16:03:52.329878 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.329861    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 16:03:52.330045 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.329975    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.330587 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330566    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 16:03:52.330669 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330634    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 16:03:52.330669 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330649    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 16:03:52.330799 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330737    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 16:03:52.330799 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330746    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 16:03:52.331005 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.330987    2562 factory.go:55] Registering systemd factory
Jul 08 16:03:52.331088 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331045    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 08 16:03:52.331285 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331264    2562 factory.go:153] Registering CRI-O factory
Jul 08 16:03:52.331285 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331286    2562 factory.go:223] Registration of the crio container factory successfully
Jul 08 16:03:52.331449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331346    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 16:03:52.331449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331372    2562 factory.go:103] Registering Raw factory
Jul 08 16:03:52.331449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331402    2562 manager.go:1196] Started watching for new ooms in manager
Jul 08 16:03:52.331982 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.331965    2562 manager.go:349] Starting recovery of all containers
Jul 08 16:03:52.333136 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.333118    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdwbc"
Jul 08 16:03:52.341669 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.341506    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:52.343217 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.343201    2562 manager.go:354] Recovery completed
Jul 08 16:03:52.346228 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.346209    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.347643 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.347631    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.349593 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.349572    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.349676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.349610    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.349676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.349624    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.350196 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.350181    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 16:03:52.350272 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.350193    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 16:03:52.350272 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.350219    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:03:52.350272 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.350186    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.351465 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351447    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.351545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351478    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.351545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351490    2562 policy_none.go:49] "None policy: Start"
Jul 08 16:03:52.351545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351506    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 16:03:52.351545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351522    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 16:03:52.351739 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.351491    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.352596 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.352584    2562 policy_none.go:47] "Start"
Jul 08 16:03:52.391551 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.391532    2562 manager.go:337] "Starting Device Plugin manager"
Jul 08 16:03:52.391647 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.391566    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 16:03:52.391647 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.391576    2562 server.go:87] "Starting device plugin registration server"
Jul 08 16:03:52.391868 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.391855    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 16:03:52.391937 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.391869    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 16:03:52.391985 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.391964    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 16:03:52.392063 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.392049    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 16:03:52.392063 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.392063    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 16:03:52.392595 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.392576    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 16:03:52.392675 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.392620    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.493146 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.493084    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.494292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.494088    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.494292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.494142    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.494292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.494161    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.494292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.494193    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.502870 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.502852    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.502978 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.502875    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-121.ec2.internal\": node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.520226 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.520207    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.545464 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.545436    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 16:03:52.546814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.546793    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 16:03:52.546891 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.546830    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 16:03:52.546891 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.546850    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 16:03:52.546891 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.546886    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 16:03:52.553025 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.553001    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:52.621628 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.621603    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.647902 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.647873    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"]
Jul 08 16:03:52.647966 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.647948    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.650340 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.650324    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.650424 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.650359    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.650424 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.650376    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.651748 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.651732    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.651858 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.651841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.651919 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.651890    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.652598 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.652583    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.652653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.652611    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.652653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.652622    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.653594 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.653577    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.653708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.653607    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.653708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.653617    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.654839 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.654822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.654904 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.654855    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:03:52.655628 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.655609    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:03:52.655688 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.655650    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:03:52.655688 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.655666    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:03:52.681613 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.681589    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.686340 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.686323    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.722212 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.722188    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.732235 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.732216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.732295 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.732241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f681de8e64470bdc7eb29251e740caf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"4f681de8e64470bdc7eb29251e740caf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.732295 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.732260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.822546 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.822479    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.832560 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.832560 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.832647 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.832647 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f681de8e64470bdc7eb29251e740caf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"4f681de8e64470bdc7eb29251e740caf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.832720 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832646    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f681de8e64470bdc7eb29251e740caf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"4f681de8e64470bdc7eb29251e740caf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.832720 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.832677    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a2c92e3187eed937be301e5383c0729-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"8a2c92e3187eed937be301e5383c0729\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.930135 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:52.930094    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:52.988992 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.988961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:52.990161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:52.990145    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:53.030830 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:53.030804    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:53.136062 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:53.135970    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:53.236955 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:53.236907    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:53.259772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.259746    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 16:03:53.259934 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.259909    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 16:03:53.259979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.259909    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 16:03:53.335343 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.335299    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:58:53 +0000 UTC" deadline="2027-12-05 14:27:56.818822477 +0000 UTC"
Jul 08 16:03:53.335343 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.335338    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12358h24m3.483488151s"
Jul 08 16:03:53.337672 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:53.337658    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 08 16:03:53.393815 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.393750    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:53.430503 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.430461    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:53.444481 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.444460    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:03:53.446639 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.446623    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 08 16:03:53.448351 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.448332    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:53.456879 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.456851    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:03:53.577654 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:53.577565    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:03:54.309579 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.309540    2562 apiserver.go:52] "Watching apiserver"
Jul 08 16:03:54.318183 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.318150    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 16:03:54.318602 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.318578    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-kjxxs","openshift-ovn-kubernetes/ovnkube-node-hzd2j","kube-system/global-pull-secret-syncer-6vd4z","kube-system/konnectivity-agent-tjjsm","kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal","openshift-dns/node-resolver-2qt6c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-cp649","openshift-multus/network-metrics-daemon-fdxf5","openshift-network-diagnostics/network-check-target-nhqk9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c","openshift-cluster-node-tuning-operator/tuned-g4s96","openshift-image-registry/node-ca-75qvs","openshift-multus/multus-6bwlz"]
Jul 08 16:03:54.320255 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.320237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:54.320345 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.320321    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:03:54.321711 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.321685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.323093 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.323072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.323179 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.323151    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:03:54.324084 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.324060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 16:03:54.324473 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.324431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.325629 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.325609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.326047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.325758    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.326047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.325827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.326354 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.326336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x462d\""
Jul 08 16:03:54.326993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.326971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.327730 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.327709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 16:03:54.328215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.328197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.328312 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.328267    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:03:54.329504 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.329381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.330233 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.330214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rdr6c\""
Jul 08 16:03:54.330473 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.330444    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 16:03:54.330749 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.330727    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 16:03:54.331245 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331225    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.331471 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331450    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hg56\""
Jul 08 16:03:54.331641 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331624    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.331728 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 16:03:54.332150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331802    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z7xwj\""
Jul 08 16:03:54.332150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331712    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.332150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331860    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.332150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.332150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.331967    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 16:03:54.334132 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.334107    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b9wbw\""
Jul 08 16:03:54.334229 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.334173    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.336963 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.336873    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 16:03:54.337253 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.337146    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.337253 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.337216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.337524 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.337495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 16:03:54.337982 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.337825    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 16:03:54.337982 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.337900    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.338209 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.338193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tqf7x\""
Jul 08 16:03:54.338310 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.338236    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 16:03:54.338310 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.338244    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.338310 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.338244    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 16:03:54.338913 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.338890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.340219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.340200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4ftsg\""
Jul 08 16:03:54.340316 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.340201    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.340433 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.340413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.341278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.341114    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 16:03:54.341278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.341176    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.341440 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.341292    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dk68r\""
Jul 08 16:03:54.341540 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.341509    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 16:03:54.341785 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.341765    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 16:03:54.342943 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.342921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b54a212a-94bb-46dd-b266-3d30d666e02b-agent-certs\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.343046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.342956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40625286-0103-447c-b7b6-ab0c69cdd403-host\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.343046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.342983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-dbus\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.343046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-etc-kubernetes\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b54a212a-94bb-46dd-b266-3d30d666e02b-konnectivity-ca\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08f6e348-bfff-4722-919a-5b4788b3144a-hosts-file\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-device-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-registration-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.343223 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-kubelet-config\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-kubelet\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-multus-daemon-config\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-multus-certs\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-bin\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-systemd-units\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343492 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-multus\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-var-lib-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-node-log\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-script-lib\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-sys-fs\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-cni-binary-copy\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-log-socket\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-config\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovn-node-metrics-cert\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tj9t\" (UniqueName: \"kubernetes.io/projected/d58be549-c2fa-4474-aa10-67e3e27f2b37-kube-api-access-5tj9t\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.343794 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-bin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-netns\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-systemd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-ovn\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-system-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.343971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-etc-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-slash\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-kubelet\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bksnx\" (UniqueName: \"kubernetes.io/projected/10a651d4-0640-440e-b4d6-28885d5a280c-kube-api-access-bksnx\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-cnibin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-conf-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jz42\" (UniqueName: \"kubernetes.io/projected/08f6e348-bfff-4722-919a-5b4788b3144a-kube-api-access-4jz42\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-socket-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-netd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-netns\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-hostroot\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-env-overrides\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f6e348-bfff-4722-919a-5b4788b3144a-tmp-dir\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-os-release\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-socket-dir-parent\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45s5f\" (UniqueName: \"kubernetes.io/projected/a8e661ec-63d6-466b-87f2-5e2919b5a88b-kube-api-access-45s5f\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kbb\" (UniqueName: \"kubernetes.io/projected/30ed6908-e51f-4cbf-b415-afad588c7048-kube-api-access-l2kbb\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-k8s-cni-cncf-io\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40625286-0103-447c-b7b6-ab0c69cdd403-serviceca\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.344887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.344675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfw5w\" (UniqueName: \"kubernetes.io/projected/40625286-0103-447c-b7b6-ab0c69cdd403-kube-api-access-zfw5w\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.345446 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.345426    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqcc9\""
Jul 08 16:03:54.345517 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.345489    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:03:54.346083 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.346064    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 16:03:54.351222 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.351200    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:03:54.378277 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.378251    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q74x"
Jul 08 16:03:54.389026 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.389007    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q74x"
Jul 08 16:03:54.431329 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.431308    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 16:03:54.445232 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovn-node-metrics-cert\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tj9t\" (UniqueName: \"kubernetes.io/projected/d58be549-c2fa-4474-aa10-67e3e27f2b37-kube-api-access-5tj9t\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-bin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445326    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-bin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.445543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-netns\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-systemd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-ovn\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-netns\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-ovn\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445567    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-systemd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.445578    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-system-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-systemd\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.445685    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.945666404 +0000 UTC m=+3.083191354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445689    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-system-cni-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-tmp\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-host-slash\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.445814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-etc-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445826    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-etc-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-slash\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-kubelet\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-slash\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bksnx\" (UniqueName: \"kubernetes.io/projected/10a651d4-0640-440e-b4d6-28885d5a280c-kube-api-access-bksnx\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-modprobe-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdzj\" (UniqueName: \"kubernetes.io/projected/363f52f6-3473-400e-9e9f-61e9dfd305da-kube-api-access-dgdzj\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.445983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-kubelet\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl57j\" (UniqueName: \"kubernetes.io/projected/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-kube-api-access-sl57j\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-system-cni-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-cnibin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-conf-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysconfig\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-cnibin\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-cnibin\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.446442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446160    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-conf-dir\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jz42\" (UniqueName: \"kubernetes.io/projected/08f6e348-bfff-4722-919a-5b4788b3144a-kube-api-access-4jz42\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-socket-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-conf\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-netd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-netns\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446289    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-hostroot\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-host\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-hostroot\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446366    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-netns\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-socket-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446397    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-netd\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bh4\" (UniqueName: \"kubernetes.io/projected/b2ca60ca-f568-41ab-b851-077892cc4a2d-kube-api-access-z7bh4\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.447257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-env-overrides\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f6e348-bfff-4722-919a-5b4788b3144a-tmp-dir\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-os-release\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-socket-dir-parent\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45s5f\" (UniqueName: \"kubernetes.io/projected/a8e661ec-63d6-466b-87f2-5e2919b5a88b-kube-api-access-45s5f\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-os-release\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446663    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-multus-socket-dir-parent\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kbb\" (UniqueName: \"kubernetes.io/projected/30ed6908-e51f-4cbf-b415-afad588c7048-kube-api-access-l2kbb\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-k8s-cni-cncf-io\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40625286-0103-447c-b7b6-ab0c69cdd403-serviceca\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfw5w\" (UniqueName: \"kubernetes.io/projected/40625286-0103-447c-b7b6-ab0c69cdd403-kube-api-access-zfw5w\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446877    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-k8s-cni-cncf-io\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-iptables-alerter-script\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f6e348-bfff-4722-919a-5b4788b3144a-tmp-dir\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b54a212a-94bb-46dd-b266-3d30d666e02b-agent-certs\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.448206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40625286-0103-447c-b7b6-ab0c69cdd403-host\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-dbus\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.446993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-etc-kubernetes\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-kubernetes\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40625286-0103-447c-b7b6-ab0c69cdd403-host\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-os-release\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447057    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-env-overrides\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b54a212a-94bb-46dd-b266-3d30d666e02b-konnectivity-ca\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447081    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-etc-kubernetes\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08f6e348-bfff-4722-919a-5b4788b3144a-hosts-file\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08f6e348-bfff-4722-919a-5b4788b3144a-hosts-file\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-device-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-sys\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-dbus\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-lib-modules\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-device-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40625286-0103-447c-b7b6-ab0c69cdd403-serviceca\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-registration-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-kubelet-config\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-registration-dir\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-tuned\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6baffc-9360-4166-a8db-0a950ae9232c-kubelet-config\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-kubelet\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-multus-daemon-config\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-multus-certs\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-var-lib-kubelet\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447463    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-kubelet\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-bin\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447578    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-run-multus-certs\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447573    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b54a212a-94bb-46dd-b266-3d30d666e02b-konnectivity-ca\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-host-cni-bin\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.449736 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.447649    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-systemd-units\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-run\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.447707    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.947688391 +0000 UTC m=+3.085213332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447725    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-systemd-units\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-multus\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-var-lib-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-node-log\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-script-lib\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ed6908-e51f-4cbf-b415-afad588c7048-host-var-lib-cni-multus\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-node-log\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-var-lib-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-sys-fs\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.450290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.447980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-cni-binary-copy\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a651d4-0640-440e-b4d6-28885d5a280c-sys-fs\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-multus-daemon-config\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-log-socket\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-log-socket\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-config\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448086    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d58be549-c2fa-4474-aa10-67e3e27f2b37-run-openvswitch\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448354    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-script-lib\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448477    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ed6908-e51f-4cbf-b415-afad588c7048-cni-binary-copy\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.448481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovnkube-config\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.449016    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d58be549-c2fa-4474-aa10-67e3e27f2b37-ovn-node-metrics-cert\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.450759 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.449616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b54a212a-94bb-46dd-b266-3d30d666e02b-agent-certs\") pod \"konnectivity-agent-tjjsm\" (UID: \"b54a212a-94bb-46dd-b266-3d30d666e02b\") " pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.455661 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.455642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tj9t\" (UniqueName: \"kubernetes.io/projected/d58be549-c2fa-4474-aa10-67e3e27f2b37-kube-api-access-5tj9t\") pod \"ovnkube-node-hzd2j\" (UID: \"d58be549-c2fa-4474-aa10-67e3e27f2b37\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.455748 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.455734    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:03:54.455796 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.455752    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:03:54.455796 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.455763    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:54.455862 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.455805    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.955793216 +0000 UTC m=+3.093318142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:54.458076 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.458055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jz42\" (UniqueName: \"kubernetes.io/projected/08f6e348-bfff-4722-919a-5b4788b3144a-kube-api-access-4jz42\") pod \"node-resolver-2qt6c\" (UID: \"08f6e348-bfff-4722-919a-5b4788b3144a\") " pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.458244 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.458227    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kbb\" (UniqueName: \"kubernetes.io/projected/30ed6908-e51f-4cbf-b415-afad588c7048-kube-api-access-l2kbb\") pod \"multus-6bwlz\" (UID: \"30ed6908-e51f-4cbf-b415-afad588c7048\") " pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.458309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.458245    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45s5f\" (UniqueName: \"kubernetes.io/projected/a8e661ec-63d6-466b-87f2-5e2919b5a88b-kube-api-access-45s5f\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.458309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.458244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bksnx\" (UniqueName: \"kubernetes.io/projected/10a651d4-0640-440e-b4d6-28885d5a280c-kube-api-access-bksnx\") pod \"aws-ebs-csi-driver-node-4j99c\" (UID: \"10a651d4-0640-440e-b4d6-28885d5a280c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.458954 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.458934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfw5w\" (UniqueName: \"kubernetes.io/projected/40625286-0103-447c-b7b6-ab0c69cdd403-kube-api-access-zfw5w\") pod \"node-ca-75qvs\" (UID: \"40625286-0103-447c-b7b6-ab0c69cdd403\") " pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.518968 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.518938    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:54.548911 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.548865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-var-lib-kubelet\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.548939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.548986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-run\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.549055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-var-lib-kubelet\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-systemd\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-tmp\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-host-slash\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-run\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-systemd\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549175    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-modprobe-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549235    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-host-slash\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549346    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-modprobe-d\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdzj\" (UniqueName: \"kubernetes.io/projected/363f52f6-3473-400e-9e9f-61e9dfd305da-kube-api-access-dgdzj\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl57j\" (UniqueName: \"kubernetes.io/projected/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-kube-api-access-sl57j\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-system-cni-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysconfig\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysconfig\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.549715 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-system-cni-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-cnibin\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-conf\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-cnibin\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-host\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-host\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.549989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-sysctl-conf\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7bh4\" (UniqueName: \"kubernetes.io/projected/b2ca60ca-f568-41ab-b851-077892cc4a2d-kube-api-access-z7bh4\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-iptables-alerter-script\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-kubernetes\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-os-release\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-sys\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-lib-modules\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550194    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-kubernetes\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-tuned\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550264    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-sys\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ca60ca-f568-41ab-b851-077892cc4a2d-os-release\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363f52f6-3473-400e-9e9f-61e9dfd305da-lib-modules\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.550791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.550626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-iptables-alerter-script\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.551272 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.551006    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.551466 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.551434    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ca60ca-f568-41ab-b851-077892cc4a2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.552237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.552213    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-tmp\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.552583 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.552510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" event={"ID":"4f681de8e64470bdc7eb29251e740caf","Type":"ContainerStarted","Data":"8794c6e52144d941dee6ba0c82d47f2d1b1fe567ce8978809bf705b272e516b6"}
Jul 08 16:03:54.553116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.553090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363f52f6-3473-400e-9e9f-61e9dfd305da-etc-tuned\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.553735 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.553701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"8a2c92e3187eed937be301e5383c0729","Type":"ContainerStarted","Data":"75533600c0a6ef04b7ccec241cef83295d96964e9f37671c6c326ef19e037024"}
Jul 08 16:03:54.560460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.560408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdzj\" (UniqueName: \"kubernetes.io/projected/363f52f6-3473-400e-9e9f-61e9dfd305da-kube-api-access-dgdzj\") pod \"tuned-g4s96\" (UID: \"363f52f6-3473-400e-9e9f-61e9dfd305da\") " pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.560557 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.560534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl57j\" (UniqueName: \"kubernetes.io/projected/e99b5ed3-caed-4672-ab55-5a3e36eeecbf-kube-api-access-sl57j\") pod \"iptables-alerter-kjxxs\" (UID: \"e99b5ed3-caed-4672-ab55-5a3e36eeecbf\") " pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.560636 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.560591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7bh4\" (UniqueName: \"kubernetes.io/projected/b2ca60ca-f568-41ab-b851-077892cc4a2d-kube-api-access-z7bh4\") pod \"multus-additional-cni-plugins-cp649\" (UID: \"b2ca60ca-f568-41ab-b851-077892cc4a2d\") " pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.620555 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.620527    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:03:54.634791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.634765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c"
Jul 08 16:03:54.643670 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.643651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:03:54.654724 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.654701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bwlz"
Jul 08 16:03:54.659035 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.659015    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2qt6c"
Jul 08 16:03:54.667781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.667761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75qvs"
Jul 08 16:03:54.674597 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.674576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:03:54.684396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.684369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjxxs"
Jul 08 16:03:54.690106 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.690084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp649"
Jul 08 16:03:54.696923 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.696904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g4s96"
Jul 08 16:03:54.954527 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.954447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:54.954527 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:54.954513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:54.954744 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.954613    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:54.954744 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.954651    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:54.954744 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.954700    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:03:55.954676186 +0000 UTC m=+4.092201114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:54.954744 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:54.954722    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:03:55.954711563 +0000 UTC m=+4.092236493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:54.973271 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.973241    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40625286_0103_447c_b7b6_ab0c69cdd403.slice/crio-bc4b7c93a23b7dca6037be4553ada60d07b3d7e89a88fe4a5d6e137dc9371441 WatchSource:0}: Error finding container bc4b7c93a23b7dca6037be4553ada60d07b3d7e89a88fe4a5d6e137dc9371441: Status 404 returned error can't find the container with id bc4b7c93a23b7dca6037be4553ada60d07b3d7e89a88fe4a5d6e137dc9371441
Jul 08 16:03:54.986665 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.986635    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a651d4_0640_440e_b4d6_28885d5a280c.slice/crio-b5cb3317e0684d11201ce71e5f2e40113a7b5c0af01162feb81982fb18a9e97f WatchSource:0}: Error finding container b5cb3317e0684d11201ce71e5f2e40113a7b5c0af01162feb81982fb18a9e97f: Status 404 returned error can't find the container with id b5cb3317e0684d11201ce71e5f2e40113a7b5c0af01162feb81982fb18a9e97f
Jul 08 16:03:54.992702 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.992655    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54a212a_94bb_46dd_b266_3d30d666e02b.slice/crio-5a66752ef3c0003190cdfe6bd3a5421df2bb586e91272fc5ce39f7cc5f1b069f WatchSource:0}: Error finding container 5a66752ef3c0003190cdfe6bd3a5421df2bb586e91272fc5ce39f7cc5f1b069f: Status 404 returned error can't find the container with id 5a66752ef3c0003190cdfe6bd3a5421df2bb586e91272fc5ce39f7cc5f1b069f
Jul 08 16:03:54.994748 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.994728    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58be549_c2fa_4474_aa10_67e3e27f2b37.slice/crio-57292ea5de9089430c68506afe53209aeaee0c0d0df20d82d6f3af356268f347 WatchSource:0}: Error finding container 57292ea5de9089430c68506afe53209aeaee0c0d0df20d82d6f3af356268f347: Status 404 returned error can't find the container with id 57292ea5de9089430c68506afe53209aeaee0c0d0df20d82d6f3af356268f347
Jul 08 16:03:54.995781 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.995753    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363f52f6_3473_400e_9e9f_61e9dfd305da.slice/crio-c90691adadd7d441c08029adb45dbc4da01d77b7a9cf49371e23983bc4cef0ec WatchSource:0}: Error finding container c90691adadd7d441c08029adb45dbc4da01d77b7a9cf49371e23983bc4cef0ec: Status 404 returned error can't find the container with id c90691adadd7d441c08029adb45dbc4da01d77b7a9cf49371e23983bc4cef0ec
Jul 08 16:03:54.996746 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.996722    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f6e348_bfff_4722_919a_5b4788b3144a.slice/crio-aa8b84042d039c59239d60b8ee2a4eca433a5533ccbdaa3f59c351a83604c974 WatchSource:0}: Error finding container aa8b84042d039c59239d60b8ee2a4eca433a5533ccbdaa3f59c351a83604c974: Status 404 returned error can't find the container with id aa8b84042d039c59239d60b8ee2a4eca433a5533ccbdaa3f59c351a83604c974
Jul 08 16:03:54.997698 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.997680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99b5ed3_caed_4672_ab55_5a3e36eeecbf.slice/crio-b3f80f7aaf180a9f7096ad3f58b9ad7fe3680d083793aa623397d18cef463576 WatchSource:0}: Error finding container b3f80f7aaf180a9f7096ad3f58b9ad7fe3680d083793aa623397d18cef463576: Status 404 returned error can't find the container with id b3f80f7aaf180a9f7096ad3f58b9ad7fe3680d083793aa623397d18cef463576
Jul 08 16:03:54.998914 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.998869    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ed6908_e51f_4cbf_b415_afad588c7048.slice/crio-f11cad09de1dcf18f99da3912cacc858a04b594b56d61803b444d9c6b486c190 WatchSource:0}: Error finding container f11cad09de1dcf18f99da3912cacc858a04b594b56d61803b444d9c6b486c190: Status 404 returned error can't find the container with id f11cad09de1dcf18f99da3912cacc858a04b594b56d61803b444d9c6b486c190
Jul 08 16:03:55.000039 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:03:54.999911    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ca60ca_f568_41ab_b851_077892cc4a2d.slice/crio-0287d68aa2cd651dfe80d987568f751812d34c89507cce26fadbee23f5357d20 WatchSource:0}: Error finding container 0287d68aa2cd651dfe80d987568f751812d34c89507cce26fadbee23f5357d20: Status 404 returned error can't find the container with id 0287d68aa2cd651dfe80d987568f751812d34c89507cce26fadbee23f5357d20
Jul 08 16:03:55.054954 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.054908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:55.055110 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.055046    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:03:55.055110 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.055061    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:03:55.055110 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.055070    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:55.055239 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.055168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:56.055140958 +0000 UTC m=+4.192665887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:55.392383 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.392081    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:58:54 +0000 UTC" deadline="2027-12-24 20:24:58.201983307 +0000 UTC"
Jul 08 16:03:55.392951 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.392386    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12820h21m2.809604317s"
Jul 08 16:03:55.552046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.548161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:55.552046 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.548316    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:03:55.560146 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.560109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjxxs" event={"ID":"e99b5ed3-caed-4672-ab55-5a3e36eeecbf","Type":"ContainerStarted","Data":"b3f80f7aaf180a9f7096ad3f58b9ad7fe3680d083793aa623397d18cef463576"}
Jul 08 16:03:55.575740 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.575650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2qt6c" event={"ID":"08f6e348-bfff-4722-919a-5b4788b3144a","Type":"ContainerStarted","Data":"aa8b84042d039c59239d60b8ee2a4eca433a5533ccbdaa3f59c351a83604c974"}
Jul 08 16:03:55.586216 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.586174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g4s96" event={"ID":"363f52f6-3473-400e-9e9f-61e9dfd305da","Type":"ContainerStarted","Data":"c90691adadd7d441c08029adb45dbc4da01d77b7a9cf49371e23983bc4cef0ec"}
Jul 08 16:03:55.593946 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.593900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"57292ea5de9089430c68506afe53209aeaee0c0d0df20d82d6f3af356268f347"}
Jul 08 16:03:55.606532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.606502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tjjsm" event={"ID":"b54a212a-94bb-46dd-b266-3d30d666e02b","Type":"ContainerStarted","Data":"5a66752ef3c0003190cdfe6bd3a5421df2bb586e91272fc5ce39f7cc5f1b069f"}
Jul 08 16:03:55.613792 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.613729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75qvs" event={"ID":"40625286-0103-447c-b7b6-ab0c69cdd403","Type":"ContainerStarted","Data":"bc4b7c93a23b7dca6037be4553ada60d07b3d7e89a88fe4a5d6e137dc9371441"}
Jul 08 16:03:55.619560 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.619264    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a2c92e3187eed937be301e5383c0729" containerID="1595e04d0c662e5cf6fdffb51906a725df9728ec9a87eb175d7729f958f37a5b" exitCode=0
Jul 08 16:03:55.619560 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.619339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"8a2c92e3187eed937be301e5383c0729","Type":"ContainerDied","Data":"1595e04d0c662e5cf6fdffb51906a725df9728ec9a87eb175d7729f958f37a5b"}
Jul 08 16:03:55.638176 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.638091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bwlz" event={"ID":"30ed6908-e51f-4cbf-b415-afad588c7048","Type":"ContainerStarted","Data":"f11cad09de1dcf18f99da3912cacc858a04b594b56d61803b444d9c6b486c190"}
Jul 08 16:03:55.641619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.641535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c" event={"ID":"10a651d4-0640-440e-b4d6-28885d5a280c","Type":"ContainerStarted","Data":"b5cb3317e0684d11201ce71e5f2e40113a7b5c0af01162feb81982fb18a9e97f"}
Jul 08 16:03:55.645691 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.645630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerStarted","Data":"0287d68aa2cd651dfe80d987568f751812d34c89507cce26fadbee23f5357d20"}
Jul 08 16:03:55.963609 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.963578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:55.963754 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:55.963680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:55.963859 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.963841    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:55.963953 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.963936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:03:57.963915357 +0000 UTC m=+6.101440311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:55.964399 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.964377    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:55.964500 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:55.964438    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:03:57.964421814 +0000 UTC m=+6.101946746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:56.065094 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.064399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:56.065094 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.064603    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:03:56.065094 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.064626    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:03:56.065094 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.064640    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:56.065094 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.064703    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:58.064683796 +0000 UTC m=+6.202208726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:56.393297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.393241    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:58:54 +0000 UTC" deadline="2028-04-02 17:49:48.941979276 +0000 UTC"
Jul 08 16:03:56.393297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.393288    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h45m52.548697042s"
Jul 08 16:03:56.548019 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.547306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:56.548019 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.547464    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:03:56.548019 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.547956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:56.548299 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:56.548067    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:03:56.656103 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.656012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"8a2c92e3187eed937be301e5383c0729","Type":"ContainerStarted","Data":"9679ace2ada1c63b6a51b2c2238ebec47b48e99508713aa5f39ad9370c30ed73"}
Jul 08 16:03:56.682805 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:56.682728    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" podStartSLOduration=2.682702582 podStartE2EDuration="2.682702582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:56.681566882 +0000 UTC m=+4.819091834" watchObservedRunningTime="2026-07-08 16:03:56.682702582 +0000 UTC m=+4.820227534"
Jul 08 16:03:57.547767 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:57.547734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:57.548288 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:57.547876    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:03:57.983147 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:57.983062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:57.983147 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:57.983126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:57.983389 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:57.983290    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:57.983389 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:57.983355    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:04:01.983334079 +0000 UTC m=+10.120859017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:03:57.983980 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:57.983750    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:57.983980 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:57.983802    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:04:01.983787049 +0000 UTC m=+10.121311978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:03:58.084357 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:58.084320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:58.084538 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.084510    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:03:58.084538 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.084533    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:03:58.084671 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.084546    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:58.084671 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.084609    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:02.084589109 +0000 UTC m=+10.222114063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:03:58.547916 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:58.547717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:03:58.548427 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.548139    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:03:58.548624 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:58.548601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:03:58.548742 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:58.548719    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:03:59.548591 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:03:59.547959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:03:59.548591 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:03:59.548116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:00.550887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:00.550853    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:00.551323 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:00.550899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:00.551323 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:00.550999    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:00.551323 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:00.551118    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:01.547593 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:01.547558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:01.547783 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:01.547706    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:02.019620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:02.019690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.019793    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.019886    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:04:10.01984723 +0000 UTC m=+18.157372157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.019931    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:02.020017 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.019989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:04:10.019970923 +0000 UTC m=+18.157495867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:02.120298 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:02.120258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:02.120467 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.120422    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:04:02.120467 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.120444    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:04:02.120467 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.120456    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:02.120629 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.120520    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:10.120502233 +0000 UTC m=+18.258027157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:02.551825 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:02.551793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:02.552028 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.551931    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:02.552325 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:02.552304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:02.552436 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:02.552410    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:03.547659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:03.547240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:03.547659 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:03.547374    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:04.550623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:04.550569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:04.551078 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:04.550702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:04.551078 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:04.550769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:04.551078 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:04.550917    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:05.547590 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:05.547558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:05.547793 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:05.547685    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:06.547551 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:06.547517    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:06.548080 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:06.547643    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:06.548080 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:06.547707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:06.548080 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:06.547812    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:07.547392 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:07.547363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:07.547565 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:07.547468    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:08.547744 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:08.547705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:08.548163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:08.547749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:08.548163 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:08.547874    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:08.548163 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:08.547978    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:09.547056 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:09.547021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:09.547270 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:09.547149    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:10.078120 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:10.078078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:10.078580 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:10.078145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:10.078580 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.078239    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:10.078580 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.078271    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:10.078580 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.078324    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:04:26.078301657 +0000 UTC m=+34.215826583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:10.078580 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.078347    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:04:26.078336215 +0000 UTC m=+34.215861141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:10.178980 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:10.178942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:10.179152 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.179132    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:04:10.179207 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.179160    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:04:10.179207 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.179173    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:10.179303 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.179237    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:26.179216976 +0000 UTC m=+34.316741913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:10.547985 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:10.547901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:10.548146 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:10.547904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:10.548146 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.548033    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:10.548251 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:10.548153    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:11.547908 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:11.547823    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:11.548323 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:11.547945    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:12.548564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:12.548529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:12.549040 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:12.548659    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:12.549040 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:12.548697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:12.549040 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:12.548770    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:13.547276 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:13.547245    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:13.547439 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:13.547347    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:14.548057 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:14.548019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:14.548057 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:14.548029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:14.548783 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:14.548231    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:14.548783 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:14.548654    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:15.548173 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.547884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:15.548711 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:15.548270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:15.695094 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.695068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tjjsm" event={"ID":"b54a212a-94bb-46dd-b266-3d30d666e02b","Type":"ContainerStarted","Data":"f54de41e4be4200733f7c5a1ca768ebe55e3c062c7f9965656b68e2272e30223"}
Jul 08 16:04:15.696439 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.696411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75qvs" event={"ID":"40625286-0103-447c-b7b6-ab0c69cdd403","Type":"ContainerStarted","Data":"84b7cd37e77c17cface74455a5631376dbb90d60c47a6ff181ec1b06bc3f54fc"}
Jul 08 16:04:15.697637 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.697613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" event={"ID":"4f681de8e64470bdc7eb29251e740caf","Type":"ContainerStarted","Data":"0bd853818b67b83baf93cc02a8a59fb42981f1359278c8ff8716af2ca273733d"}
Jul 08 16:04:15.701915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.701890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bwlz" event={"ID":"30ed6908-e51f-4cbf-b415-afad588c7048","Type":"ContainerStarted","Data":"f903dbcfd7e52805c7fc656518b985386f300be230ad2ef2c762aeaa1f964d3b"}
Jul 08 16:04:15.703095 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.703073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c" event={"ID":"10a651d4-0640-440e-b4d6-28885d5a280c","Type":"ContainerStarted","Data":"517ce9ded2a643da2416f2272e3f095e453697080cc5c28cb407dccffe1f342b"}
Jul 08 16:04:15.704480 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.704455    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="d3e0f0d491c49e5bcec3300f473d2069bcc79d8411798d6b74b99b6420066e1a" exitCode=0
Jul 08 16:04:15.704564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.704496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"d3e0f0d491c49e5bcec3300f473d2069bcc79d8411798d6b74b99b6420066e1a"}
Jul 08 16:04:15.706052 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.706009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2qt6c" event={"ID":"08f6e348-bfff-4722-919a-5b4788b3144a","Type":"ContainerStarted","Data":"ca93e245b2cfbeb816342a84810a279420cafee3b57b49d5fecb97be3f040b73"}
Jul 08 16:04:15.707583 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.707557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g4s96" event={"ID":"363f52f6-3473-400e-9e9f-61e9dfd305da","Type":"ContainerStarted","Data":"f2c7b6c1084d677b2a76e26362c59125cc6dfd97b04ae9681edab817a9695e31"}
Jul 08 16:04:15.710642 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.710619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"085429b637661f1621162228389cb1d9c6da77b63c4fcaf0ce84379b5fc8b3f3"}
Jul 08 16:04:15.710726 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.710678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"2b436c5e5d4cdeff8bc403cf646c1e37f83c58c322d49fedfe3b2675030757a7"}
Jul 08 16:04:15.710726 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.710708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"51abdcc2bf14b5e451e90509e1b89a2d70f14a2d5fbd5d24bbc5a35b4c6603e8"}
Jul 08 16:04:15.710809 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.710736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"4a237c1021886a7bd14002a566f30717c3f78bdf10361783445ea46cdcb4be35"}
Jul 08 16:04:15.710809 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.710763    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"bf8bc638245c19be7e5ed4c50c37a42ebdae3f645bac98abf80aec9f31148b1a"}
Jul 08 16:04:15.714976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.714941    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tjjsm" podStartSLOduration=2.733571589 podStartE2EDuration="22.714930092s" totalImagesPullingTime="19.981358503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.714383295 +0000 UTC m=+23.851908243" watchObservedRunningTime="2026-07-08 16:04:15.714930092 +0000 UTC m=+23.852455063"
Jul 08 16:04:15.734177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.734136    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6bwlz" podStartSLOduration=2.690754535 podStartE2EDuration="22.734123295s" totalImagesPullingTime="20.04336876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.733542888 +0000 UTC m=+23.871067834" watchObservedRunningTime="2026-07-08 16:04:15.734123295 +0000 UTC m=+23.871648239"
Jul 08 16:04:15.752752 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.752685    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-75qvs" podStartSLOduration=2.761890389 podStartE2EDuration="22.752663491s" totalImagesPullingTime="19.990773102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.75201263 +0000 UTC m=+23.889537578" watchObservedRunningTime="2026-07-08 16:04:15.752663491 +0000 UTC m=+23.890188439"
Jul 08 16:04:15.809991 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.809944    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" podStartSLOduration=21.809927812 podStartE2EDuration="21.809927812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.793006351 +0000 UTC m=+23.930531298" watchObservedRunningTime="2026-07-08 16:04:15.809927812 +0000 UTC m=+23.947452758"
Jul 08 16:04:15.831165 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.831100    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g4s96" podStartSLOduration=2.858755187 podStartE2EDuration="22.831080374s" totalImagesPullingTime="19.972325187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.831064394 +0000 UTC m=+23.968589341" watchObservedRunningTime="2026-07-08 16:04:15.831080374 +0000 UTC m=+23.968605322"
Jul 08 16:04:15.831665 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:15.831623    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2qt6c" podStartSLOduration=2.855222351 podStartE2EDuration="22.831608581s" totalImagesPullingTime="19.97638623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:15.810187481 +0000 UTC m=+23.947712421" watchObservedRunningTime="2026-07-08 16:04:15.831608581 +0000 UTC m=+23.969133531"
Jul 08 16:04:16.547597 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.547533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:16.547597 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.547556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:16.547789 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:16.547636    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:16.547830 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:16.547783    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:16.715294 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.715261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjxxs" event={"ID":"e99b5ed3-caed-4672-ab55-5a3e36eeecbf","Type":"ContainerStarted","Data":"16690b470f7e7fcdbd39a903bbb73043636eeceaa319b8cec4c9e3052aa96bef"}
Jul 08 16:04:16.718116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.718091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"394a1b253a5fefae61fde3aafaaf0d83c083ccd8e3ff62e0a688978042bf0acb"}
Jul 08 16:04:16.732142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.732105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kjxxs" podStartSLOduration=3.747884995 podStartE2EDuration="23.732092738s" totalImagesPullingTime="19.984207743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:16.731939668 +0000 UTC m=+24.869464612" watchObservedRunningTime="2026-07-08 16:04:16.732092738 +0000 UTC m=+24.869617685"
Jul 08 16:04:16.754417 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:16.754396    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 16:04:17.405817 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:17.405691    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:04:16.75441435Z","UUID":"88f7edcb-d565-4c4d-a69a-b4046975856c","Handler":null,"Name":"","Endpoint":""}
Jul 08 16:04:17.407393 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:17.407369    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 16:04:17.407526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:17.407406    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 16:04:17.547993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:17.547958    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:17.548200 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:17.548111    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:17.721517 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:17.721444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c" event={"ID":"10a651d4-0640-440e-b4d6-28885d5a280c","Type":"ContainerStarted","Data":"deebe62a0ababfb6e7da60f8a4a564b73b852d1b50cd484f12957d49e269fbcc"}
Jul 08 16:04:18.547825 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:18.547585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:18.548019 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:18.547637    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:18.548019 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:18.547968    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:18.548138 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:18.548035    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:18.728281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:18.728240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"3b95430f433fbb2fc8a289289fe555ea326bdc41f24c71fe927aeeaf4be092ab"}
Jul 08 16:04:18.730415 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:18.730392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c" event={"ID":"10a651d4-0640-440e-b4d6-28885d5a280c","Type":"ContainerStarted","Data":"a3b6b6341b0b68a8b6a1fa60c6dbda815b5765b1e70d5d9602aeaa93a5d41b43"}
Jul 08 16:04:18.750944 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:18.750892    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4j99c" podStartSLOduration=3.269205107 podStartE2EDuration="25.750872578s" totalImagesPullingTime="22.481667471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:18.750034332 +0000 UTC m=+26.887559290" watchObservedRunningTime="2026-07-08 16:04:18.750872578 +0000 UTC m=+26.888397520"
Jul 08 16:04:19.547673 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:19.547640    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:19.547841 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:19.547749    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:20.009018 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.008987    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:04:20.009598 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.009479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:04:20.023984 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.023963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:04:20.024364 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.024347    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tjjsm"
Jul 08 16:04:20.547653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.547432    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:20.547848 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.547459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:20.547848 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:20.547801    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:20.547848 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:20.547831    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:20.740477 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.740436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" event={"ID":"d58be549-c2fa-4474-aa10-67e3e27f2b37","Type":"ContainerStarted","Data":"fe82021e23ed3c0b1c2d061a3dc2f49a2eb40cae130ba4585b45b66f92cacbc0"}
Jul 08 16:04:20.771194 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:20.771135    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j" podStartSLOduration=7.700994604 podStartE2EDuration="27.771114759s" totalImagesPullingTime="20.070120155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:20.770088461 +0000 UTC m=+28.907613446" watchObservedRunningTime="2026-07-08 16:04:20.771114759 +0000 UTC m=+28.908639706"
Jul 08 16:04:21.548027 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.547991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:21.548586 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:21.548098    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:21.742770 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.742700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:21.742972 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.742787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:21.742972 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.742834    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:21.759696 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.759666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:21.764355 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:21.764335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:22.548828 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:22.548749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:22.549278 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:22.548848    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:22.549278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:22.548899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:22.549278 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:22.548989    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:22.745904 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:22.745869    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="9ff16552bf4a410b31dd8a62274c15bc0f9aa3f82b34a3f06c79ece579fe4b14" exitCode=0
Jul 08 16:04:22.746040 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:22.745918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"9ff16552bf4a410b31dd8a62274c15bc0f9aa3f82b34a3f06c79ece579fe4b14"}
Jul 08 16:04:23.547345 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:23.547314    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:23.547491 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:23.547412    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:24.547981 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:24.547951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:24.548338 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:24.547951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:24.548338 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:24.548070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:24.548338 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:24.548112    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:24.751952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:24.751916    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="d77ce1aaa81ef2df96a8d56d7b806df60a582ac2d6e618f151d8355cdf286fef" exitCode=0
Jul 08 16:04:24.752092 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:24.751983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"d77ce1aaa81ef2df96a8d56d7b806df60a582ac2d6e618f151d8355cdf286fef"}
Jul 08 16:04:25.547897 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:25.547845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:25.548041 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:25.547967    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:26.100466 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:26.100433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:26.100605 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:26.100472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:26.100605 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.100572    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:26.100605 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.100573    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:26.100717 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.100624    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs podName:a8e661ec-63d6-466b-87f2-5e2919b5a88b nodeName:}" failed. No retries permitted until 2026-07-08 16:04:58.100609927 +0000 UTC m=+66.238134852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs") pod "network-metrics-daemon-fdxf5" (UID: "a8e661ec-63d6-466b-87f2-5e2919b5a88b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:04:26.100717 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.100636    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret podName:7f6baffc-9360-4166-a8db-0a950ae9232c nodeName:}" failed. No retries permitted until 2026-07-08 16:04:58.100630489 +0000 UTC m=+66.238155415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret") pod "global-pull-secret-syncer-6vd4z" (UID: "7f6baffc-9360-4166-a8db-0a950ae9232c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:04:26.201569 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:26.201540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:26.201709 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.201689    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:04:26.201709 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.201707    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:04:26.201793 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.201732    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5nv4s for pod openshift-network-diagnostics/network-check-target-nhqk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:26.201793 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.201777    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s podName:e693d65a-a0a3-4529-bb93-ce815ba1da43 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:58.201765164 +0000 UTC m=+66.339290089 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nv4s" (UniqueName: "kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s") pod "network-check-target-nhqk9" (UID: "e693d65a-a0a3-4529-bb93-ce815ba1da43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:04:26.547440 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:26.547363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:26.547567 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.547452    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:26.547567 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:26.547537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:26.547676 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:26.547655    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:27.547296 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:27.547266    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:27.547653 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:27.547363    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:27.760716 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:27.760684    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="343b7b7cf029f9201fe7db1aabe3b9d4803edd23e1e0596ebb5df9d6b27bec88" exitCode=0
Jul 08 16:04:27.760841 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:27.760744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"343b7b7cf029f9201fe7db1aabe3b9d4803edd23e1e0596ebb5df9d6b27bec88"}
Jul 08 16:04:28.429608 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.429430    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6vd4z"]
Jul 08 16:04:28.429821 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.429706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:28.429918 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:28.429822    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:28.435364 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.435334    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdxf5"]
Jul 08 16:04:28.435510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.435493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:28.435635 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:28.435611    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:28.437090 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.437068    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhqk9"]
Jul 08 16:04:28.437186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:28.437156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:28.437248 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:28.437227    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:30.547479 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:30.547401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:30.547479 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:30.547425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:30.548194 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:30.547401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:30.548194 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:30.547531    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdxf5" podUID="a8e661ec-63d6-466b-87f2-5e2919b5a88b"
Jul 08 16:04:30.548194 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:30.547600    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhqk9" podUID="e693d65a-a0a3-4529-bb93-ce815ba1da43"
Jul 08 16:04:30.548194 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:30.547656    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6vd4z" podUID="7f6baffc-9360-4166-a8db-0a950ae9232c"
Jul 08 16:04:31.609841 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.609805    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeReady"
Jul 08 16:04:31.610301 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.609994    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 16:04:31.659526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.659495    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b85d48547-4x26z"]
Jul 08 16:04:31.689783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.689754    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d9fzj"]
Jul 08 16:04:31.689963 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.689886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.693833 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.693807    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 16:04:31.693997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.693882    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 16:04:31.694172 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.694153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 16:04:31.694252 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.694218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hjrqc\""
Jul 08 16:04:31.703625 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.703605    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 16:04:31.709774 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.709747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b85d48547-4x26z"]
Jul 08 16:04:31.710497 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.709789    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ttkdg"]
Jul 08 16:04:31.710497 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.709877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.713532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.713511    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 16:04:31.713662 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.713645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xz56b\""
Jul 08 16:04:31.713951 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.713925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 16:04:31.728020 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.727997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttkdg"]
Jul 08 16:04:31.728161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.728036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d9fzj"]
Jul 08 16:04:31.728161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.728064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cswwj"]
Jul 08 16:04:31.728261 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.728241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.731595 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.731457    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zdhd9\""
Jul 08 16:04:31.731595 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.731504    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 16:04:31.731595 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.731580    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 16:04:31.732021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.732000    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 16:04:31.741822 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.741803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cswwj"]
Jul 08 16:04:31.741949 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.741912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.745239 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.745188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2pd8l\""
Jul 08 16:04:31.745347 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.745325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 16:04:31.745412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.745403    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 16:04:31.745465 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.745433    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 16:04:31.745611 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.745585    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 16:04:31.841621 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t25p\" (UniqueName: \"kubernetes.io/projected/78e18bc5-1b45-4e83-9171-db32d0f611b6-kube-api-access-8t25p\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.841791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-crio-socket\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.841791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-data-volume\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.841791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-installation-pull-secrets\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.841791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-bound-sa-token\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.841791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnf6\" (UniqueName: \"kubernetes.io/projected/172e81bc-141e-4a35-87b6-eada05ce22f6-kube-api-access-klnf6\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlcnr\" (UniqueName: \"kubernetes.io/projected/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-api-access-hlcnr\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-trusted-ca\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/172e81bc-141e-4a35-87b6-eada05ce22f6-metrics-tls\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.841987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/172e81bc-141e-4a35-87b6-eada05ce22f6-tmp-dir\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.842104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e18bc5-1b45-4e83-9171-db32d0f611b6-cert\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef7c15e8-c666-452b-8f0c-82b5526ae29a-ca-trust-extracted\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ng6\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-kube-api-access-k8ng6\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/172e81bc-141e-4a35-87b6-eada05ce22f6-config-volume\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-image-registry-private-configuration\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-tls\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.842380 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.842330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-certificates\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943069 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t25p\" (UniqueName: \"kubernetes.io/projected/78e18bc5-1b45-4e83-9171-db32d0f611b6-kube-api-access-8t25p\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.943069 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-crio-socket\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-data-volume\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-installation-pull-secrets\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-bound-sa-token\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnf6\" (UniqueName: \"kubernetes.io/projected/172e81bc-141e-4a35-87b6-eada05ce22f6-kube-api-access-klnf6\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlcnr\" (UniqueName: \"kubernetes.io/projected/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-api-access-hlcnr\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-trusted-ca\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/172e81bc-141e-4a35-87b6-eada05ce22f6-metrics-tls\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.943306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/172e81bc-141e-4a35-87b6-eada05ce22f6-tmp-dir\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e18bc5-1b45-4e83-9171-db32d0f611b6-cert\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943345    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-crio-socket\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef7c15e8-c666-452b-8f0c-82b5526ae29a-ca-trust-extracted\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ng6\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-kube-api-access-k8ng6\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-data-volume\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/172e81bc-141e-4a35-87b6-eada05ce22f6-config-volume\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-image-registry-private-configuration\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-tls\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.943708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.943567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-certificates\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.944581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.944428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/172e81bc-141e-4a35-87b6-eada05ce22f6-config-volume\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.944764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.944742    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef7c15e8-c666-452b-8f0c-82b5526ae29a-ca-trust-extracted\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.945251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.945223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-trusted-ca\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.945610 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.945586    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.945784 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.945763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-certificates\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.945955 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.945931    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/172e81bc-141e-4a35-87b6-eada05ce22f6-tmp-dir\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.948900 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.948733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/172e81bc-141e-4a35-87b6-eada05ce22f6-metrics-tls\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.948900 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.948848    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-image-registry-private-configuration\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.949050 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.948959    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef7c15e8-c666-452b-8f0c-82b5526ae29a-installation-pull-secrets\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.949213 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.949177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.949279 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.949222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-registry-tls\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.949451 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.949426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e18bc5-1b45-4e83-9171-db32d0f611b6-cert\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:31.956523 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.956497    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-bound-sa-token\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.956623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.956542    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnf6\" (UniqueName: \"kubernetes.io/projected/172e81bc-141e-4a35-87b6-eada05ce22f6-kube-api-access-klnf6\") pod \"dns-default-d9fzj\" (UID: \"172e81bc-141e-4a35-87b6-eada05ce22f6\") " pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:31.957100 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.957075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlcnr\" (UniqueName: \"kubernetes.io/projected/bc05f5d0-4ff9-4669-9ba4-9eac689c9170-kube-api-access-hlcnr\") pod \"insights-runtime-extractor-cswwj\" (UID: \"bc05f5d0-4ff9-4669-9ba4-9eac689c9170\") " pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:31.957184 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.957120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ng6\" (UniqueName: \"kubernetes.io/projected/ef7c15e8-c666-452b-8f0c-82b5526ae29a-kube-api-access-k8ng6\") pod \"image-registry-6b85d48547-4x26z\" (UID: \"ef7c15e8-c666-452b-8f0c-82b5526ae29a\") " pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:31.957184 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:31.957143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t25p\" (UniqueName: \"kubernetes.io/projected/78e18bc5-1b45-4e83-9171-db32d0f611b6-kube-api-access-8t25p\") pod \"ingress-canary-ttkdg\" (UID: \"78e18bc5-1b45-4e83-9171-db32d0f611b6\") " pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:32.002206 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.002121    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:32.020341 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.020302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:32.038147 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.038122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttkdg"
Jul 08 16:04:32.053990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.053972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cswwj"
Jul 08 16:04:32.549148 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.549102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:32.549350 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.549198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:32.549350 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.549237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:32.552015 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.551976    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 16:04:32.552015 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.552020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:04:32.552212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.552036    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wzt7p\""
Jul 08 16:04:32.552212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.552083    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:04:32.552212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.552115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pr5b4\""
Jul 08 16:04:32.552212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.552025    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 16:04:32.947438 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.947229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cswwj"]
Jul 08 16:04:32.951130 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.950805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d9fzj"]
Jul 08 16:04:32.951534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.951515    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b85d48547-4x26z"]
Jul 08 16:04:32.953842 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:32.953821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttkdg"]
Jul 08 16:04:33.015498 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:33.015469    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc05f5d0_4ff9_4669_9ba4_9eac689c9170.slice/crio-ca9ec797194d670a14f60f949f0a4ef4bcc317e47657156d76eac303f65afdeb WatchSource:0}: Error finding container ca9ec797194d670a14f60f949f0a4ef4bcc317e47657156d76eac303f65afdeb: Status 404 returned error can't find the container with id ca9ec797194d670a14f60f949f0a4ef4bcc317e47657156d76eac303f65afdeb
Jul 08 16:04:33.016228 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:33.016202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172e81bc_141e_4a35_87b6_eada05ce22f6.slice/crio-4695aba7a2a6a433f0c504ccaa94846b2135ac9cf8c76936fccce45e4df80fe3 WatchSource:0}: Error finding container 4695aba7a2a6a433f0c504ccaa94846b2135ac9cf8c76936fccce45e4df80fe3: Status 404 returned error can't find the container with id 4695aba7a2a6a433f0c504ccaa94846b2135ac9cf8c76936fccce45e4df80fe3
Jul 08 16:04:33.017372 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:33.017333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7c15e8_c666_452b_8f0c_82b5526ae29a.slice/crio-7ebddebda939a241c03f2b8383b4779133322078c70304eb70a5083d8e08ae27 WatchSource:0}: Error finding container 7ebddebda939a241c03f2b8383b4779133322078c70304eb70a5083d8e08ae27: Status 404 returned error can't find the container with id 7ebddebda939a241c03f2b8383b4779133322078c70304eb70a5083d8e08ae27
Jul 08 16:04:33.017637 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:33.017618    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e18bc5_1b45_4e83_9171_db32d0f611b6.slice/crio-a2118477f3651414c1c48165dda2545c594c109fea8259bf30e196ceb1c84ffd WatchSource:0}: Error finding container a2118477f3651414c1c48165dda2545c594c109fea8259bf30e196ceb1c84ffd: Status 404 returned error can't find the container with id a2118477f3651414c1c48165dda2545c594c109fea8259bf30e196ceb1c84ffd
Jul 08 16:04:33.780616 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.780536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9fzj" event={"ID":"172e81bc-141e-4a35-87b6-eada05ce22f6","Type":"ContainerStarted","Data":"4695aba7a2a6a433f0c504ccaa94846b2135ac9cf8c76936fccce45e4df80fe3"}
Jul 08 16:04:33.782247 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.782217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttkdg" event={"ID":"78e18bc5-1b45-4e83-9171-db32d0f611b6","Type":"ContainerStarted","Data":"a2118477f3651414c1c48165dda2545c594c109fea8259bf30e196ceb1c84ffd"}
Jul 08 16:04:33.787251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.787226    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="64c25ee87a0025d934b484fc9f93fd6642baada16cf45d574e8675195ec26c1f" exitCode=0
Jul 08 16:04:33.787356 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.787311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"64c25ee87a0025d934b484fc9f93fd6642baada16cf45d574e8675195ec26c1f"}
Jul 08 16:04:33.790274 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.790186    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cswwj" event={"ID":"bc05f5d0-4ff9-4669-9ba4-9eac689c9170","Type":"ContainerStarted","Data":"ca9ec797194d670a14f60f949f0a4ef4bcc317e47657156d76eac303f65afdeb"}
Jul 08 16:04:33.795836 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.795201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b85d48547-4x26z" event={"ID":"ef7c15e8-c666-452b-8f0c-82b5526ae29a","Type":"ContainerStarted","Data":"ca3263ff4149a7a13d699e58173c8503de18d071ec25a6c340f15d60b3ab1155"}
Jul 08 16:04:33.795836 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.795240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b85d48547-4x26z" event={"ID":"ef7c15e8-c666-452b-8f0c-82b5526ae29a","Type":"ContainerStarted","Data":"7ebddebda939a241c03f2b8383b4779133322078c70304eb70a5083d8e08ae27"}
Jul 08 16:04:33.795836 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.795485    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:33.838301 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:33.837544    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b85d48547-4x26z" podStartSLOduration=6.837522059 podStartE2EDuration="6.837522059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:33.836655402 +0000 UTC m=+41.974180351" watchObservedRunningTime="2026-07-08 16:04:33.837522059 +0000 UTC m=+41.975047007"
Jul 08 16:04:34.800374 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:34.800184    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2ca60ca-f568-41ab-b851-077892cc4a2d" containerID="e6b1a73b53b03c85ecb5373caf67f4ebd3acda0e9b4225e6b3e3da99df2b1b1d" exitCode=0
Jul 08 16:04:34.800813 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:34.800246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerDied","Data":"e6b1a73b53b03c85ecb5373caf67f4ebd3acda0e9b4225e6b3e3da99df2b1b1d"}
Jul 08 16:04:35.807017 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:35.806959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp649" event={"ID":"b2ca60ca-f568-41ab-b851-077892cc4a2d","Type":"ContainerStarted","Data":"0edf2db4541ac0c87865921048596c4315282ba941fe7738b41c45df3156c548"}
Jul 08 16:04:35.831692 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:35.831627    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cp649" podStartSLOduration=7.57318545 podStartE2EDuration="42.831611881s" totalImagesPullingTime="35.258426431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:35.831577724 +0000 UTC m=+43.969102671" watchObservedRunningTime="2026-07-08 16:04:35.831611881 +0000 UTC m=+43.969136830"
Jul 08 16:04:39.817921 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.817888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cswwj" event={"ID":"bc05f5d0-4ff9-4669-9ba4-9eac689c9170","Type":"ContainerStarted","Data":"dc5b31903964c85722fb6c01f8d41d264460645aa495ed8e3ea58f59c24a5397"}
Jul 08 16:04:39.819610 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.819581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9fzj" event={"ID":"172e81bc-141e-4a35-87b6-eada05ce22f6","Type":"ContainerStarted","Data":"9c7c5c187c2dc68ebc3d0dacce2dd0b4a6a16ce81ee69ebb300033d89b0de45a"}
Jul 08 16:04:39.819717 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.819624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9fzj" event={"ID":"172e81bc-141e-4a35-87b6-eada05ce22f6","Type":"ContainerStarted","Data":"c144d5a972882a5724dbb6ad3400296d14fa0cc50d1c9ed0fecc11abd7c9ccb1"}
Jul 08 16:04:39.819717 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.819664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:39.821059 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.821036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttkdg" event={"ID":"78e18bc5-1b45-4e83-9171-db32d0f611b6","Type":"ContainerStarted","Data":"cf73dce558cb67b6bd2a109e3fed635c0e3586c6a0ca10ee10edf070bacc663f"}
Jul 08 16:04:39.838635 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.838591    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d9fzj" podStartSLOduration=2.618410457 podStartE2EDuration="8.838577784s" totalImagesPullingTime="6.220167327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:39.837320812 +0000 UTC m=+47.974845760" watchObservedRunningTime="2026-07-08 16:04:39.838577784 +0000 UTC m=+47.976102731"
Jul 08 16:04:39.853562 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:39.853502    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ttkdg" podStartSLOduration=2.627227826 podStartE2EDuration="8.853484195s" totalImagesPullingTime="6.226256369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:39.853234436 +0000 UTC m=+47.990759383" watchObservedRunningTime="2026-07-08 16:04:39.853484195 +0000 UTC m=+47.991009145"
Jul 08 16:04:41.829782 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:41.829601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cswwj" event={"ID":"bc05f5d0-4ff9-4669-9ba4-9eac689c9170","Type":"ContainerStarted","Data":"474b29e6066227384946fa34560de74807bdc908643aa224997b327901639aaa"}
Jul 08 16:04:44.841963 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:44.841921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cswwj" event={"ID":"bc05f5d0-4ff9-4669-9ba4-9eac689c9170","Type":"ContainerStarted","Data":"082edd193c11e603303380cb191b14d4d9a94df60c1edc58ec7452f63f149369"}
Jul 08 16:04:44.863460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:44.863389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cswwj" podStartSLOduration=2.83759323 podStartE2EDuration="13.863374171s" totalImagesPullingTime="11.025780941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:04:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:44.861783583 +0000 UTC m=+52.999308568" watchObservedRunningTime="2026-07-08 16:04:44.863374171 +0000 UTC m=+53.000899117"
Jul 08 16:04:49.651556 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.651523    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wqtvt"]
Jul 08 16:04:49.654166 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.654151    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.659994 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.659968    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 16:04:49.660116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.660033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 16:04:49.660116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.660065    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 16:04:49.660976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.660959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 16:04:49.661749 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.661732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 16:04:49.662289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.662272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2kxh\""
Jul 08 16:04:49.663195 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.663179    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 16:04:49.672155 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672254 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672254 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-root\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672254 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672379 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8f4\" (UniqueName: \"kubernetes.io/projected/f1513385-b268-4393-8284-b29b2769b30c-kube-api-access-6p8f4\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672379 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-wtmp\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672379 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-sys\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-textfile\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.672494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.672410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-metrics-client-ca\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.772870 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8f4\" (UniqueName: \"kubernetes.io/projected/f1513385-b268-4393-8284-b29b2769b30c-kube-api-access-6p8f4\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-wtmp\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-sys\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-textfile\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:49.772985    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.772998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-metrics-client-ca\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:49.773060    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls podName:f1513385-b268-4393-8284-b29b2769b30c nodeName:}" failed. No retries permitted until 2026-07-08 16:04:50.273037965 +0000 UTC m=+58.410562890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls") pod "node-exporter-wqtvt" (UID: "f1513385-b268-4393-8284-b29b2769b30c") : secret "node-exporter-tls" not found
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-wtmp\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773099 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773060    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-sys\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-root\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1513385-b268-4393-8284-b29b2769b30c-root\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-textfile\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773679 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773652    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.773772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.773686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1513385-b268-4393-8284-b29b2769b30c-metrics-client-ca\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.776924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.776898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.782425 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.782403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8f4\" (UniqueName: \"kubernetes.io/projected/f1513385-b268-4393-8284-b29b2769b30c-kube-api-access-6p8f4\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:49.825965 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:49.825948    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d9fzj"
Jul 08 16:04:50.275912 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.275874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:50.278167 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.278142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1513385-b268-4393-8284-b29b2769b30c-node-exporter-tls\") pod \"node-exporter-wqtvt\" (UID: \"f1513385-b268-4393-8284-b29b2769b30c\") " pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:50.562511 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.562487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wqtvt"
Jul 08 16:04:50.572720 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:50.572694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1513385_b268_4393_8284_b29b2769b30c.slice/crio-a0e5c2cfc53626f5f741e24f9aed5c2d05159b3f83cde63386fc6dacd961dd0d WatchSource:0}: Error finding container a0e5c2cfc53626f5f741e24f9aed5c2d05159b3f83cde63386fc6dacd961dd0d: Status 404 returned error can't find the container with id a0e5c2cfc53626f5f741e24f9aed5c2d05159b3f83cde63386fc6dacd961dd0d
Jul 08 16:04:50.666021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.665989    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:04:50.668484 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.668459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.671079 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.671058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 16:04:50.671192 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.671152    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 16:04:50.673154 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.673138    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 16:04:50.673259 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.673183    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 16:04:50.673259 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.673200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 16:04:50.673259 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.673235    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dsp2c\""
Jul 08 16:04:50.673501 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.673487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 16:04:50.675484 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.675467    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 16:04:50.675972 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.675957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 16:04:50.676070 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.675988    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 16:04:50.678417 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678571 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678571 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678571 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vwh\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678897 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.678897 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.678746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.690962 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.690942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:04:50.779142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vwh\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.779384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.779387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.780772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.780131    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.780772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.780711    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.780974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.780842    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.782360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.782333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.782491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.782424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.782583 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.782564    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.782829 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.782788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.783131 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.783111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.783250 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.783185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.783428 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.783405    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.783521 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.783504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.783835 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.783818    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.791822 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.791801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vwh\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh\") pod \"alertmanager-main-0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:50.860250 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.860171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqtvt" event={"ID":"f1513385-b268-4393-8284-b29b2769b30c","Type":"ContainerStarted","Data":"a0e5c2cfc53626f5f741e24f9aed5c2d05159b3f83cde63386fc6dacd961dd0d"}
Jul 08 16:04:50.977469 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:50.977438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:04:51.135215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.135131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:04:51.144784 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:51.144757    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e28573d_1ddf_48f1_98b3_cb44ed89d4c0.slice/crio-9d1435f2635efe49c7cbfb3eb505592da8229de7c146f3cc068945b41efece85 WatchSource:0}: Error finding container 9d1435f2635efe49c7cbfb3eb505592da8229de7c146f3cc068945b41efece85: Status 404 returned error can't find the container with id 9d1435f2635efe49c7cbfb3eb505592da8229de7c146f3cc068945b41efece85
Jul 08 16:04:51.698129 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.698097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7884c575cc-fpd5x"]
Jul 08 16:04:51.700770 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.700750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.715906 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.715885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fa4beteq3bthe\""
Jul 08 16:04:51.716234 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716217    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 16:04:51.716313 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716247    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 16:04:51.716313 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716304    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 16:04:51.716400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716340    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l7x56\""
Jul 08 16:04:51.716400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716388    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 16:04:51.716739 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.716722    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 16:04:51.724082 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.724048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7884c575cc-fpd5x"]
Jul 08 16:04:51.787436 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787600 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-grpc-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxgg\" (UniqueName: \"kubernetes.io/projected/2665d38c-7c7b-4798-8e63-233149f7d4d6-kube-api-access-dwxgg\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2665d38c-7c7b-4798-8e63-233149f7d4d6-metrics-client-ca\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.787975 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.787820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.865108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.865065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"9d1435f2635efe49c7cbfb3eb505592da8229de7c146f3cc068945b41efece85"}
Jul 08 16:04:51.888713 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.888915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.888915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.888915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-grpc-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.888915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxgg\" (UniqueName: \"kubernetes.io/projected/2665d38c-7c7b-4798-8e63-233149f7d4d6-kube-api-access-dwxgg\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.889138 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2665d38c-7c7b-4798-8e63-233149f7d4d6-metrics-client-ca\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.889138 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.889138 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.888984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.890027 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.889978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2665d38c-7c7b-4798-8e63-233149f7d4d6-metrics-client-ca\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.892511 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.892470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-grpc-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.893094 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.892749    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.893094 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.893045    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-tls\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.893262 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.893161    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.894622 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.894580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.895143 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.895118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2665d38c-7c7b-4798-8e63-233149f7d4d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:51.898422 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:51.898382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxgg\" (UniqueName: \"kubernetes.io/projected/2665d38c-7c7b-4798-8e63-233149f7d4d6-kube-api-access-dwxgg\") pod \"thanos-querier-7884c575cc-fpd5x\" (UID: \"2665d38c-7c7b-4798-8e63-233149f7d4d6\") " pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:52.007381 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.007349    2562 patch_prober.go:28] interesting pod/image-registry-6b85d48547-4x26z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 16:04:52.007484 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.007407    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b85d48547-4x26z" podUID="ef7c15e8-c666-452b-8f0c-82b5526ae29a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:04:52.011559 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.011534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:52.168395 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.168305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7884c575cc-fpd5x"]
Jul 08 16:04:52.408097 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:52.408005    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2665d38c_7c7b_4798_8e63_233149f7d4d6.slice/crio-1f25261974eea6cb81a3cfd3d8bebe547708159f1e73f041e22dd75cd98b55c6 WatchSource:0}: Error finding container 1f25261974eea6cb81a3cfd3d8bebe547708159f1e73f041e22dd75cd98b55c6: Status 404 returned error can't find the container with id 1f25261974eea6cb81a3cfd3d8bebe547708159f1e73f041e22dd75cd98b55c6
Jul 08 16:04:52.869466 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.869432    2562 generic.go:356] "Generic (PLEG): container finished" podID="f1513385-b268-4393-8284-b29b2769b30c" containerID="fb9d78e33867c9b6f2d0100a6af016b72e4e1cd44b458ebc54d0958f8f9277eb" exitCode=0
Jul 08 16:04:52.869914 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.869524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqtvt" event={"ID":"f1513385-b268-4393-8284-b29b2769b30c","Type":"ContainerDied","Data":"fb9d78e33867c9b6f2d0100a6af016b72e4e1cd44b458ebc54d0958f8f9277eb"}
Jul 08 16:04:52.870737 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.870708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"1f25261974eea6cb81a3cfd3d8bebe547708159f1e73f041e22dd75cd98b55c6"}
Jul 08 16:04:52.872354 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.872330    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="761f290e2e49ca8fa1c2275fcb92051c234fe749de3a000888b7e7a4b886fc29" exitCode=0
Jul 08 16:04:52.872452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:52.872368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"761f290e2e49ca8fa1c2275fcb92051c234fe749de3a000888b7e7a4b886fc29"}
Jul 08 16:04:53.760818 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:53.760787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzd2j"
Jul 08 16:04:53.877205 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:53.877170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqtvt" event={"ID":"f1513385-b268-4393-8284-b29b2769b30c","Type":"ContainerStarted","Data":"9fab09d5e79f4cc0c1911dac40a15a9974feade196a4740c3ccb9f4369479c3b"}
Jul 08 16:04:53.877573 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:53.877223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqtvt" event={"ID":"f1513385-b268-4393-8284-b29b2769b30c","Type":"ContainerStarted","Data":"2a06af720ab012af10a2cf81b887fd4b838887d8ad91112fb3eb61a6120a344c"}
Jul 08 16:04:53.903103 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:53.903056    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wqtvt" podStartSLOduration=3.403042839 podStartE2EDuration="4.903039186s" totalImagesPullingTime="1.419900366s" totalInitContainerRuntime="80.095981ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:53.902108961 +0000 UTC m=+62.039633910" watchObservedRunningTime="2026-07-08 16:04:53.903039186 +0000 UTC m=+62.040564177"
Jul 08 16:04:54.194925 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.194894    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6797f4b689-9mlwp"]
Jul 08 16:04:54.211917 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.211882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6797f4b689-9mlwp"]
Jul 08 16:04:54.212089 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.212014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.214686 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.214652    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 16:04:54.214813 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.214712    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 16:04:54.214813 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.214749    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 16:04:54.215116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.215083    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dl8zf\""
Jul 08 16:04:54.215734 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.215544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 16:04:54.215734 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.215721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8qliev52tlibo\""
Jul 08 16:04:54.309133 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309285 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-client-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309285 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7d2\" (UniqueName: \"kubernetes.io/projected/78ce094b-a178-4bac-a157-4c3f79b1a8ab-kube-api-access-2z7d2\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309381 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-client-certs\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-tls\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309574 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78ce094b-a178-4bac-a157-4c3f79b1a8ab-audit-log\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.309574 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.309484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-metrics-server-audit-profiles\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.350713 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.350677    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"]
Jul 08 16:04:54.369360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.369326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"]
Jul 08 16:04:54.369490 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.369444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.372041 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.372014    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jqw8x\""
Jul 08 16:04:54.372324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.372310    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 16:04:54.410129 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.410286 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtq7j\" (UniqueName: \"kubernetes.io/projected/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-kube-api-access-jtq7j\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.410286 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-client-certs\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-tls\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78ce094b-a178-4bac-a157-4c3f79b1a8ab-audit-log\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-metrics-server-audit-profiles\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410611 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410668 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-client-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.410668 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.410661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7d2\" (UniqueName: \"kubernetes.io/projected/78ce094b-a178-4bac-a157-4c3f79b1a8ab-kube-api-access-2z7d2\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.411169 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.411113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78ce094b-a178-4bac-a157-4c3f79b1a8ab-audit-log\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.411604 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.411583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.411723 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.411660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78ce094b-a178-4bac-a157-4c3f79b1a8ab-metrics-server-audit-profiles\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.413214 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.413191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-client-certs\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.413318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.413292    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-secret-metrics-server-tls\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.413455 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.413432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78ce094b-a178-4bac-a157-4c3f79b1a8ab-client-ca-bundle\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.420121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.420098    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7d2\" (UniqueName: \"kubernetes.io/projected/78ce094b-a178-4bac-a157-4c3f79b1a8ab-kube-api-access-2z7d2\") pod \"metrics-server-6797f4b689-9mlwp\" (UID: \"78ce094b-a178-4bac-a157-4c3f79b1a8ab\") " pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.511734 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.511661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.511734 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.511699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtq7j\" (UniqueName: \"kubernetes.io/projected/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-kube-api-access-jtq7j\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.511920 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:54.511808    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 16:04:54.511920 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:04:54.511885    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert podName:5d505aad-d6f0-4f8d-9cc6-f47a7394a191 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:55.011870488 +0000 UTC m=+63.149395426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-rzdjj" (UID: "5d505aad-d6f0-4f8d-9cc6-f47a7394a191") : secret "monitoring-plugin-cert" not found
Jul 08 16:04:54.523962 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.523936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:04:54.529002 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.528969    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtq7j\" (UniqueName: \"kubernetes.io/projected/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-kube-api-access-jtq7j\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:54.689836 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.689804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6797f4b689-9mlwp"]
Jul 08 16:04:54.692470 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:54.692448    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ce094b_a178_4bac_a157_4c3f79b1a8ab.slice/crio-8f7d4d80c66c075d5e3479fb1098af5313698e58c140ec66414403ed21abde99 WatchSource:0}: Error finding container 8f7d4d80c66c075d5e3479fb1098af5313698e58c140ec66414403ed21abde99: Status 404 returned error can't find the container with id 8f7d4d80c66c075d5e3479fb1098af5313698e58c140ec66414403ed21abde99
Jul 08 16:04:54.805843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.805776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b85d48547-4x26z"
Jul 08 16:04:54.882475 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:54.882441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp" event={"ID":"78ce094b-a178-4bac-a157-4c3f79b1a8ab","Type":"ContainerStarted","Data":"8f7d4d80c66c075d5e3479fb1098af5313698e58c140ec66414403ed21abde99"}
Jul 08 16:04:55.016875 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.016827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:55.019613 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.019562    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5d505aad-d6f0-4f8d-9cc6-f47a7394a191-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rzdjj\" (UID: \"5d505aad-d6f0-4f8d-9cc6-f47a7394a191\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:55.279006 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.278969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:55.485182 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.485140    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"]
Jul 08 16:04:55.488321 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:55.488294    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d505aad_d6f0_4f8d_9cc6_f47a7394a191.slice/crio-166391b3458e2edafb7d2a5b94701aebd077c05498c5815ace8a6712f16214fd WatchSource:0}: Error finding container 166391b3458e2edafb7d2a5b94701aebd077c05498c5815ace8a6712f16214fd: Status 404 returned error can't find the container with id 166391b3458e2edafb7d2a5b94701aebd077c05498c5815ace8a6712f16214fd
Jul 08 16:04:55.891295 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.891188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"fdfbe5de4f48ddf37ea9c077be9dee1d12cae633511ccffb23b0c31ebf2c7100"}
Jul 08 16:04:55.891741 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.891275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"24fb3cd766e8123fe030270a52870e2b095d1de181aa869e473d8cb04dc9a3d5"}
Jul 08 16:04:55.891741 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.891371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"3b57e8f89426b4dbf6812eeb7d12b94c03edc46315c11d399674b8cacef6d514"}
Jul 08 16:04:55.891741 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.891411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"5b4b62b7eeafb1bee5b25924467702dd89d0004dc0c3bb495b23a87fe4d8636a"}
Jul 08 16:04:55.892911 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.892885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj" event={"ID":"5d505aad-d6f0-4f8d-9cc6-f47a7394a191","Type":"ContainerStarted","Data":"166391b3458e2edafb7d2a5b94701aebd077c05498c5815ace8a6712f16214fd"}
Jul 08 16:04:55.895016 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.894995    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:04:55.897645 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.897627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.900801 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.900778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 16:04:55.900926 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.900822    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 16:04:55.900926 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.900848    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 16:04:55.901113 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.900786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 16:04:55.901287 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901263    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 16:04:55.901287 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901284    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 16:04:55.901427 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901326    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 16:04:55.901611 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901592    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 16:04:55.901820 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-642qkd1avpot1\""
Jul 08 16:04:55.901895 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.901887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 16:04:55.902091 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.902074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 16:04:55.902417 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.902399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 16:04:55.902771 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.902753    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qhbjq\""
Jul 08 16:04:55.903468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.903139    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 16:04:55.904493 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.904474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 16:04:55.907444 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.907425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 16:04:55.918784 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.918754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5m7\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.925999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.929883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.930702 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.930702 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.930702 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:55.930702 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:55.926573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027521 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027592 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027650 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027701 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027701 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027792 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027792 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027792 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.027974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.027993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.028403 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5m7\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.029508 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.028974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.029508 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.029202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.029677 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.029531    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.030303 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.030275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.030405 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.030356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.030455 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.030422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.030506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.030446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.031298 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.030978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.031298 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.031092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.031697 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.031674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.031878 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.031842    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.033814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.033757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.034157 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.034131    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.034239 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.034141    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.035074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.034628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.035074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.034730    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.035222 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.035126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.036730 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.036693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.036963 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.036935    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.037585 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.037541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5m7\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7\") pod \"prometheus-k8s-0\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.210705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.210620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:04:56.475204 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.475118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:04:56.812824 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:56.812800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6a425d_0c6e_42ee_9ff0_d5dff6b1d277.slice/crio-8b6b1598022526183f6919fe34a5d532d6f171e8572f197ad264a42ebdbb9030 WatchSource:0}: Error finding container 8b6b1598022526183f6919fe34a5d532d6f171e8572f197ad264a42ebdbb9030: Status 404 returned error can't find the container with id 8b6b1598022526183f6919fe34a5d532d6f171e8572f197ad264a42ebdbb9030
Jul 08 16:04:56.902085 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.902056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"00f9917f33edf7c1647ec2f946c06118b1d629c2a311cd1919bde06d962e1e0f"}
Jul 08 16:04:56.906174 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.906137    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"8b6b1598022526183f6919fe34a5d532d6f171e8572f197ad264a42ebdbb9030"}
Jul 08 16:04:56.909065 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.909037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"0eeeb3f378544d4350c8a665b88ab440d92313a9f0f913856ff8d6c20fc7df95"}
Jul 08 16:04:56.909165 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:56.909117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"f308f9cc56c49710a29941dc046edad07ce48ec289df5713a2e56835e4fdcd84"}
Jul 08 16:04:57.916797 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.916768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerStarted","Data":"c34419f72cdde42b25814fc539baa582c0350fea016b637da238de81166d613a"}
Jul 08 16:04:57.918405 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.918364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj" event={"ID":"5d505aad-d6f0-4f8d-9cc6-f47a7394a191","Type":"ContainerStarted","Data":"449ce58da431e9e7b2b22f62d02b042a6e1a5792b46bd1b85009318c2bd264a4"}
Jul 08 16:04:57.918521 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.918505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:57.920899 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.920875    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf" exitCode=0
Jul 08 16:04:57.921119 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.920961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"}
Jul 08 16:04:57.924230 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.924208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"c82b95e0708b49e62a590f22064d303f8b2dde3204beb1a1bb28ae63a10ade01"}
Jul 08 16:04:57.924315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.924276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"20cd8da7dc5b2d6fba820ed0495c4dc62f0bea7850a6a6edec40d8e7d4ea24b3"}
Jul 08 16:04:57.924353 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.924315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"66fffa026d73dcb1108d56d9b86564594abe283c9141ca0e8b68da2206fb3759"}
Jul 08 16:04:57.925112 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.925094    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj"
Jul 08 16:04:57.925783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.925760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp" event={"ID":"78ce094b-a178-4bac-a157-4c3f79b1a8ab","Type":"ContainerStarted","Data":"4896c70b182c8a094162ae0128758aa63607ca8aa592fd780660183e56f6acd5"}
Jul 08 16:04:57.947677 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:57.947631    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.641728863 podStartE2EDuration="7.947612701s" totalImagesPullingTime="5.289348196s" totalInitContainerRuntime="16.535642ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:57.946469265 +0000 UTC m=+66.083994211" watchObservedRunningTime="2026-07-08 16:04:57.947612701 +0000 UTC m=+66.085137646"
Jul 08 16:04:58.002227 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.002130    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp" podStartSLOduration=1.858294185 podStartE2EDuration="4.002113722s" totalImagesPullingTime="2.143819537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:58.001385275 +0000 UTC m=+66.138910222" watchObservedRunningTime="2026-07-08 16:04:58.002113722 +0000 UTC m=+66.139638668"
Jul 08 16:04:58.023007 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.022959    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rzdjj" podStartSLOduration=2.201273521 podStartE2EDuration="4.02294231s" totalImagesPullingTime="1.821668789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:58.022475319 +0000 UTC m=+66.160000266" watchObservedRunningTime="2026-07-08 16:04:58.02294231 +0000 UTC m=+66.160467258"
Jul 08 16:04:58.150523 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.150485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:58.150703 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.150533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:58.153238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.153214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:04:58.153340 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.153250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:04:58.162887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.162849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e661ec-63d6-466b-87f2-5e2919b5a88b-metrics-certs\") pod \"network-metrics-daemon-fdxf5\" (UID: \"a8e661ec-63d6-466b-87f2-5e2919b5a88b\") " pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:58.162965 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.162919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6baffc-9360-4166-a8db-0a950ae9232c-original-pull-secret\") pod \"global-pull-secret-syncer-6vd4z\" (UID: \"7f6baffc-9360-4166-a8db-0a950ae9232c\") " pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:58.251384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.251346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:58.254295 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.254233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 16:04:58.264785 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.264767    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 16:04:58.275468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.275447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nv4s\" (UniqueName: \"kubernetes.io/projected/e693d65a-a0a3-4529-bb93-ce815ba1da43-kube-api-access-5nv4s\") pod \"network-check-target-nhqk9\" (UID: \"e693d65a-a0a3-4529-bb93-ce815ba1da43\") " pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:58.361702 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.361676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6vd4z"
Jul 08 16:04:58.370095 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.370075    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wzt7p\""
Jul 08 16:04:58.375589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.375570    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pr5b4\""
Jul 08 16:04:58.378623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.378600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdxf5"
Jul 08 16:04:58.383549 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.383529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:04:58.527353 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.527280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6vd4z"]
Jul 08 16:04:58.528924 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:58.528892    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6baffc_9360_4166_a8db_0a950ae9232c.slice/crio-dddc255df581d84bd58222643d243175301b37433b29fe32e10d721c1b6569a5 WatchSource:0}: Error finding container dddc255df581d84bd58222643d243175301b37433b29fe32e10d721c1b6569a5: Status 404 returned error can't find the container with id dddc255df581d84bd58222643d243175301b37433b29fe32e10d721c1b6569a5
Jul 08 16:04:58.552538 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:58.552513    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e661ec_63d6_466b_87f2_5e2919b5a88b.slice/crio-287462b9252ced4840f71443fc8293e320c87647e2501a9c88149df594912959 WatchSource:0}: Error finding container 287462b9252ced4840f71443fc8293e320c87647e2501a9c88149df594912959: Status 404 returned error can't find the container with id 287462b9252ced4840f71443fc8293e320c87647e2501a9c88149df594912959
Jul 08 16:04:58.552994 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.552976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdxf5"]
Jul 08 16:04:58.573571 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.573546    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhqk9"]
Jul 08 16:04:58.575458 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:04:58.575436    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode693d65a_a0a3_4529_bb93_ce815ba1da43.slice/crio-31f2b86b73c53d5baf71f28f154780979b91a2fa90b8d2b55c8eb5006b126b38 WatchSource:0}: Error finding container 31f2b86b73c53d5baf71f28f154780979b91a2fa90b8d2b55c8eb5006b126b38: Status 404 returned error can't find the container with id 31f2b86b73c53d5baf71f28f154780979b91a2fa90b8d2b55c8eb5006b126b38
Jul 08 16:04:58.933257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.933220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" event={"ID":"2665d38c-7c7b-4798-8e63-233149f7d4d6","Type":"ContainerStarted","Data":"df6daf1376bc0adb303cf1f6dc5403d53db954e3f20c894aa095e428ab736235"}
Jul 08 16:04:58.933751 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.933411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:04:58.934819 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.934794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhqk9" event={"ID":"e693d65a-a0a3-4529-bb93-ce815ba1da43","Type":"ContainerStarted","Data":"31f2b86b73c53d5baf71f28f154780979b91a2fa90b8d2b55c8eb5006b126b38"}
Jul 08 16:04:58.936113 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.936087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6vd4z" event={"ID":"7f6baffc-9360-4166-a8db-0a950ae9232c","Type":"ContainerStarted","Data":"dddc255df581d84bd58222643d243175301b37433b29fe32e10d721c1b6569a5"}
Jul 08 16:04:58.937272 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.937245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdxf5" event={"ID":"a8e661ec-63d6-466b-87f2-5e2919b5a88b","Type":"ContainerStarted","Data":"287462b9252ced4840f71443fc8293e320c87647e2501a9c88149df594912959"}
Jul 08 16:04:58.970639 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:58.970576    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x" podStartSLOduration=3.238785162 podStartE2EDuration="7.970560085s" totalImagesPullingTime="4.731774923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:58.969370106 +0000 UTC m=+67.106895076" watchObservedRunningTime="2026-07-08 16:04:58.970560085 +0000 UTC m=+67.108085032"
Jul 08 16:04:59.947436 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:04:59.947404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdxf5" event={"ID":"a8e661ec-63d6-466b-87f2-5e2919b5a88b","Type":"ContainerStarted","Data":"d196ccd1ef14e44349c47093c861a091dfacba6ee985cb4f77a36533c8d20050"}
Jul 08 16:05:00.955355 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:00.955174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdxf5" event={"ID":"a8e661ec-63d6-466b-87f2-5e2919b5a88b","Type":"ContainerStarted","Data":"82443c2f2d8022e97e76f2791dc7f49e7e9a16453023ed2d250db53a66267e8d"}
Jul 08 16:05:00.973894 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:00.973746    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdxf5" podStartSLOduration=66.74900374 podStartE2EDuration="1m7.973722788s" totalImagesPullingTime="1.224719048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:00.972896914 +0000 UTC m=+69.110421862" watchObservedRunningTime="2026-07-08 16:05:00.973722788 +0000 UTC m=+69.111247736"
Jul 08 16:05:04.953959 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.953937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7884c575cc-fpd5x"
Jul 08 16:05:04.974101 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.974072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhqk9" event={"ID":"e693d65a-a0a3-4529-bb93-ce815ba1da43","Type":"ContainerStarted","Data":"3f8b4bc5682ce2028072f5153c5f80acf8d349dadfc9de0766b7f3bd749b7269"}
Jul 08 16:05:04.974211 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.974131    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:05:04.975731 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.975701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6vd4z" event={"ID":"7f6baffc-9360-4166-a8db-0a950ae9232c","Type":"ContainerStarted","Data":"591046d95b48054a3a437c7a353f363b6143f93f5fc5d9daef48c0fc6db15ebd"}
Jul 08 16:05:04.979570 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.979551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"}
Jul 08 16:05:04.979659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.979599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"}
Jul 08 16:05:04.979659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.979626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"}
Jul 08 16:05:04.979659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.979650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"}
Jul 08 16:05:04.979764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:04.979687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"}
Jul 08 16:05:05.021783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:05.021669    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.360622209 podStartE2EDuration="10.021652471s" totalImagesPullingTime="6.634216171s" totalInitContainerRuntime="26.814091ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:05.021390321 +0000 UTC m=+73.158915269" watchObservedRunningTime="2026-07-08 16:05:05.021652471 +0000 UTC m=+73.159177417"
Jul 08 16:05:05.041434 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:05.041326    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6vd4z" podStartSLOduration=65.999305582 podStartE2EDuration="1m12.041310247s" totalImagesPullingTime="6.042004665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:05.039638864 +0000 UTC m=+73.177163813" watchObservedRunningTime="2026-07-08 16:05:05.041310247 +0000 UTC m=+73.178835195"
Jul 08 16:05:05.062003 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:05.061951    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nhqk9" podStartSLOduration=66.075143693 podStartE2EDuration="1m12.061935025s" totalImagesPullingTime="5.986791332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:05.0606174 +0000 UTC m=+73.198142346" watchObservedRunningTime="2026-07-08 16:05:05.061935025 +0000 UTC m=+73.199459971"
Jul 08 16:05:05.986552 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:05.986519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerStarted","Data":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"}
Jul 08 16:05:06.211646 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:06.211617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:05:14.524751 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:14.524635    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:05:14.524751 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:14.524721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:05:31.427441 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:31.427408    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttkdg_78e18bc5-1b45-4e83-9171-db32d0f611b6/serve-healthcheck-canary/0.log"
Jul 08 16:05:34.529817 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:34.529789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:05:34.533573 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:34.533548    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6797f4b689-9mlwp"
Jul 08 16:05:35.989533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:35.989501    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nhqk9"
Jul 08 16:05:56.210815 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:56.210779    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:05:56.230248 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:56.230221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:05:57.197502 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:05:57.197467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:10.048680 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.048643    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049020    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="alertmanager" containerID="cri-o://5b4b62b7eeafb1bee5b25924467702dd89d0004dc0c3bb495b23a87fe4d8636a" gracePeriod=120
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049086    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-metric" containerID="cri-o://00f9917f33edf7c1647ec2f946c06118b1d629c2a311cd1919bde06d962e1e0f" gracePeriod=120
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049095    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-web" containerID="cri-o://24fb3cd766e8123fe030270a52870e2b095d1de181aa869e473d8cb04dc9a3d5" gracePeriod=120
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049133    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="config-reloader" containerID="cri-o://3b57e8f89426b4dbf6812eeb7d12b94c03edc46315c11d399674b8cacef6d514" gracePeriod=120
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049221    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="prom-label-proxy" containerID="cri-o://c34419f72cdde42b25814fc539baa582c0350fea016b637da238de81166d613a" gracePeriod=120
Jul 08 16:06:10.049318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.049221    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy" containerID="cri-o://fdfbe5de4f48ddf37ea9c077be9dee1d12cae633511ccffb23b0c31ebf2c7100" gracePeriod=120
Jul 08 16:06:10.230160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230129    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="c34419f72cdde42b25814fc539baa582c0350fea016b637da238de81166d613a" exitCode=0
Jul 08 16:06:10.230160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230153    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="fdfbe5de4f48ddf37ea9c077be9dee1d12cae633511ccffb23b0c31ebf2c7100" exitCode=0
Jul 08 16:06:10.230160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230162    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="3b57e8f89426b4dbf6812eeb7d12b94c03edc46315c11d399674b8cacef6d514" exitCode=0
Jul 08 16:06:10.230160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230168    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="5b4b62b7eeafb1bee5b25924467702dd89d0004dc0c3bb495b23a87fe4d8636a" exitCode=0
Jul 08 16:06:10.230441 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"c34419f72cdde42b25814fc539baa582c0350fea016b637da238de81166d613a"}
Jul 08 16:06:10.230441 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"fdfbe5de4f48ddf37ea9c077be9dee1d12cae633511ccffb23b0c31ebf2c7100"}
Jul 08 16:06:10.230441 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"3b57e8f89426b4dbf6812eeb7d12b94c03edc46315c11d399674b8cacef6d514"}
Jul 08 16:06:10.230441 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:10.230368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"5b4b62b7eeafb1bee5b25924467702dd89d0004dc0c3bb495b23a87fe4d8636a"}
Jul 08 16:06:11.238990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.238953    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="00f9917f33edf7c1647ec2f946c06118b1d629c2a311cd1919bde06d962e1e0f" exitCode=0
Jul 08 16:06:11.238990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.238984    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerID="24fb3cd766e8123fe030270a52870e2b095d1de181aa869e473d8cb04dc9a3d5" exitCode=0
Jul 08 16:06:11.239347 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.238975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"00f9917f33edf7c1647ec2f946c06118b1d629c2a311cd1919bde06d962e1e0f"}
Jul 08 16:06:11.239347 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.239086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"24fb3cd766e8123fe030270a52870e2b095d1de181aa869e473d8cb04dc9a3d5"}
Jul 08 16:06:11.287661 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.287637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:06:11.467498 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467498 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467498 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467478    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467615    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467675    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vwh\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467708    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.467772 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467759    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.468219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume\") pod \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\" (UID: \"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0\") "
Jul 08 16:06:11.468219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467916    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:06:11.468219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.467940    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:11.468219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.468140    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.468219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.468164    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-alertmanager-main-db\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.470791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.470727    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.470791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.470753    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out" (OuterVolumeSpecName: "config-out") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:06:11.471136 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.470825    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:06:11.471136 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.470921    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume" (OuterVolumeSpecName: "config-volume") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.471136 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.471066    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.471136 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.471098    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:11.471330 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.471200    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.471330 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.471296    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.473051 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.473030    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh" (OuterVolumeSpecName: "kube-api-access-p9vwh") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "kube-api-access-p9vwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:06:11.475696 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.475668    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.480976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.480957    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config" (OuterVolumeSpecName: "web-config") pod "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" (UID: "7e28573d-1ddf-48f1-98b3-cb44ed89d4c0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:11.569348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569321    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569348 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569347    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-main-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569357    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-out\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569365    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569373    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-tls-assets\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569382    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vwh\" (UniqueName: \"kubernetes.io/projected/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-kube-api-access-p9vwh\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569391    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-web-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569399    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-metrics-client-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569407    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-cluster-tls-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569415    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-config-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:11.569506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:11.569423    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:12.246579 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.246526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e28573d-1ddf-48f1-98b3-cb44ed89d4c0","Type":"ContainerDied","Data":"9d1435f2635efe49c7cbfb3eb505592da8229de7c146f3cc068945b41efece85"}
Jul 08 16:06:12.247047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.246684    2562 scope.go:117] "RemoveContainer" containerID="c34419f72cdde42b25814fc539baa582c0350fea016b637da238de81166d613a"
Jul 08 16:06:12.247047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.246686    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 16:06:12.256189 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.256170    2562 scope.go:117] "RemoveContainer" containerID="00f9917f33edf7c1647ec2f946c06118b1d629c2a311cd1919bde06d962e1e0f"
Jul 08 16:06:12.263008 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.262967    2562 scope.go:117] "RemoveContainer" containerID="fdfbe5de4f48ddf37ea9c077be9dee1d12cae633511ccffb23b0c31ebf2c7100"
Jul 08 16:06:12.269306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.269287    2562 scope.go:117] "RemoveContainer" containerID="24fb3cd766e8123fe030270a52870e2b095d1de181aa869e473d8cb04dc9a3d5"
Jul 08 16:06:12.271793 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.271770    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:06:12.276100 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.276080    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 16:06:12.276948 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.276921    2562 scope.go:117] "RemoveContainer" containerID="3b57e8f89426b4dbf6812eeb7d12b94c03edc46315c11d399674b8cacef6d514"
Jul 08 16:06:12.283660 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.283646    2562 scope.go:117] "RemoveContainer" containerID="5b4b62b7eeafb1bee5b25924467702dd89d0004dc0c3bb495b23a87fe4d8636a"
Jul 08 16:06:12.290151 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.290134    2562 scope.go:117] "RemoveContainer" containerID="761f290e2e49ca8fa1c2275fcb92051c234fe749de3a000888b7e7a4b886fc29"
Jul 08 16:06:12.552544 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:12.552470    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" path="/var/lib/kubelet/pods/7e28573d-1ddf-48f1-98b3-cb44ed89d4c0/volumes"
Jul 08 16:06:14.304686 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.304654    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.304945    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="prometheus" containerID="cri-o://e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee" gracePeriod=600
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.304977    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy" containerID="cri-o://98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501" gracePeriod=600
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.305004    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="config-reloader" containerID="cri-o://60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d" gracePeriod=600
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.305012    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-web" containerID="cri-o://34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9" gracePeriod=600
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.305110    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9" gracePeriod=600
Jul 08 16:06:14.305210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.304984    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="thanos-sidecar" containerID="cri-o://bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49" gracePeriod=600
Jul 08 16:06:14.552443 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.552418    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:14.696183 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696147    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696183 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696187    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq5m7\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696225    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696249    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696727    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696878    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696925    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696934    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696953    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.696987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.696964    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.697369 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.697020    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.697369 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.697041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.697369 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.697079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.697369 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.697114    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698524 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698496    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:06:14.698699 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698765 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698733    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698771    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698842    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698888    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.698993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.698965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out\") pod \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\" (UID: \"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277\") "
Jul 08 16:06:14.699346 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.699326    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.699461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.699359    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.699461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.699374    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-db\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.699461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.699388    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.700041 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.699997    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.700142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.700066    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.700334 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.700310    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7" (OuterVolumeSpecName: "kube-api-access-pq5m7") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "kube-api-access-pq5m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:06:14.700456 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.700426    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.700970 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.700943    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.701571 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.701335    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.701892 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.701802    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.702085 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.702032    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config" (OuterVolumeSpecName: "config") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.702163 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.702135    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.705511 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.704564    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:06:14.705942 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.705918    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out" (OuterVolumeSpecName: "config-out") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:06:14.706047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.706024    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.706108 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.706063    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:06:14.706161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.706110    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.706195 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.706158    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.713247 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.713227    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config" (OuterVolumeSpecName: "web-config") pod "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" (UID: "da6a425d-0c6e-42ee-9ff0-d5dff6b1d277"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:06:14.800268 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800237    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-kube-rbac-proxy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800268 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800267    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800279    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800288    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-web-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800296    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800307    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800315    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-tls-assets\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800323    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-configmap-metrics-client-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800333    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800342    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800350    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config-out\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800358    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq5m7\" (UniqueName: \"kubernetes.io/projected/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-kube-api-access-pq5m7\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800365    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800373    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800382    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-grpc-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:14.800462 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:14.800390    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277-secret-metrics-client-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261291    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9" exitCode=0
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261316    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501" exitCode=0
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261324    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9" exitCode=0
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261330    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49" exitCode=0
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261335    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d" exitCode=0
Jul 08 16:06:15.261335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261340    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee" exitCode=0
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261378    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261559    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"}
Jul 08 16:06:15.261907 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.261711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da6a425d-0c6e-42ee-9ff0-d5dff6b1d277","Type":"ContainerDied","Data":"8b6b1598022526183f6919fe34a5d532d6f171e8572f197ad264a42ebdbb9030"}
Jul 08 16:06:15.270001 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.269985    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.276387 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.276371    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.282440 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.282366    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.285117 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.285098    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:15.289039 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.289007    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.291257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.291235    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:15.295499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.295485    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.302198 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.302185    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.308631 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.308436    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.308876 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.308694    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.308876 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.308717    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.308876 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.308748    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.308998 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.308961    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.308998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.308978    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.308998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.308993    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.309236 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.309219    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.309281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309240    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.309281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309260    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.309480 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.309464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.309520 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309483    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.309520 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309496    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.309683 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.309670    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.309721 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309686    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.309721 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309699    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.309887 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.309872    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.309952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309889    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.309952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.309901    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.310138 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:06:15.310121    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.310193 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310144    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.310193 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310158    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.310381 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310365    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.310432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310382    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.310591 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310577    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.310632 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310591    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.310797 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310779    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.310896 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.310799    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.311154 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311134    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.311154 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311152    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.311371 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311355    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.311414 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311372    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.311585 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311570    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.311585 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311585    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.311786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311767    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.311840 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311787    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.311992 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311978    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.312042 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.311993    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.312210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312191    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.312261 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312212    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.312393 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312380    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.312435 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312394    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.312599 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312583    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.312650 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312601    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.312835 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312811    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.312835 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.312833    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.313045 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313030    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.313087 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313045    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.313259 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313242    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.313302 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313260    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.313442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313426    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.313481 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313442    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.313644 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313629    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.313684 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313644    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.313834 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313819    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.313834 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.313832    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.314048 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314032    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.314089 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314049    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.314244 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314228    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.314244 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314243    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.314443 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314427    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.314488 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314444    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.314644 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.314688 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314644    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.314846 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314831    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.314913 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.314846    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.315053 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315037    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.315053 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315052    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.315232 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315215    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.315232 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315232    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.315438 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315423    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.315488 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315439    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.315635 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315621    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.315698 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315636    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.315832 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315813    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.315905 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.315833    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.316160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.316141    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.316222 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.316160    2562 scope.go:117] "RemoveContainer" containerID="2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"
Jul 08 16:06:15.316783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.316604    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9"} err="failed to get container status \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": rpc error: code = NotFound desc = could not find container \"2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9\": container with ID starting with 2694237ceeac44ef7240fb90c06ae73f61fee11401b80658f27603fb7de3f5c9 not found: ID does not exist"
Jul 08 16:06:15.316783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.316630    2562 scope.go:117] "RemoveContainer" containerID="98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"
Jul 08 16:06:15.317027 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317004    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501"} err="failed to get container status \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": rpc error: code = NotFound desc = could not find container \"98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501\": container with ID starting with 98ef846418e73d24b6008d4a9af5cb1ae6440652db316d537381e2be4cc3e501 not found: ID does not exist"
Jul 08 16:06:15.317077 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317029    2562 scope.go:117] "RemoveContainer" containerID="34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"
Jul 08 16:06:15.317319 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317296    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9"} err="failed to get container status \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": rpc error: code = NotFound desc = could not find container \"34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9\": container with ID starting with 34e11fcabc09a88ca3ac477aaa2ba3e18ed5642caf877935ba19b0ce9482d8b9 not found: ID does not exist"
Jul 08 16:06:15.317385 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317322    2562 scope.go:117] "RemoveContainer" containerID="bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"
Jul 08 16:06:15.317587 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317562    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49"} err="failed to get container status \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": rpc error: code = NotFound desc = could not find container \"bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49\": container with ID starting with bb48a22741779c26b259b0903560d940b30b837fc9fe19f0bf229ad8bf02db49 not found: ID does not exist"
Jul 08 16:06:15.317642 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317590    2562 scope.go:117] "RemoveContainer" containerID="60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"
Jul 08 16:06:15.317848 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317829    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d"} err="failed to get container status \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": rpc error: code = NotFound desc = could not find container \"60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d\": container with ID starting with 60b603c74880aa38092287b6bb4f051d9083a0216000e6f06cb6fa865c564a4d not found: ID does not exist"
Jul 08 16:06:15.317938 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317850    2562 scope.go:117] "RemoveContainer" containerID="e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"
Jul 08 16:06:15.317996 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.317980    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:15.318120 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318097    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee"} err="failed to get container status \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": rpc error: code = NotFound desc = could not find container \"e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee\": container with ID starting with e23814e1e82d7b23c844cca0dad1abe4ee1eb6d7dc74a636c08adbc6bfb76dee not found: ID does not exist"
Jul 08 16:06:15.318161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318143    2562 scope.go:117] "RemoveContainer" containerID="9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"
Jul 08 16:06:15.318246 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318230    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="alertmanager"
Jul 08 16:06:15.318246 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318247    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="alertmanager"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318257    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318265    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318277    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318284    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318298    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-metric"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318306    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-metric"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318319    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="init-config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318326    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="init-config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318337    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="init-config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318346    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="init-config-reloader"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318356    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318359    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf"} err="failed to get container status \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": rpc error: code = NotFound desc = could not find container \"9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf\": container with ID starting with 9b5ef7a37231523144793e7e0174c1bd8e11b636f6f214fbfc1ab6cad6a09bdf not found: ID does not exist"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318364    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318387    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-thanos"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318394    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-thanos"
Jul 08 16:06:15.318400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318409    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318416    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="prom-label-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318422    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="prom-label-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318427    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="thanos-sidecar"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318433    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="thanos-sidecar"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318439    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="prometheus"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318444    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="prometheus"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318450    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="config-reloader"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318456    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="config-reloader"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318462    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318467    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318528    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318535    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="prometheus"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318540    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318545    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="kube-rbac-proxy-metric"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318551    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="prom-label-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318556    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318561    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="config-reloader"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318565    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="thanos-sidecar"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318571    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-thanos"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318577    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e28573d-1ddf-48f1-98b3-cb44ed89d4c0" containerName="alertmanager"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318581    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="config-reloader"
Jul 08 16:06:15.318843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.318586    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" containerName="kube-rbac-proxy-web"
Jul 08 16:06:15.331127 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.331111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.333552 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333529    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 16:06:15.333638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 16:06:15.333638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 16:06:15.333638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333593    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 16:06:15.333911 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333889    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 16:06:15.333997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.333986    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 16:06:15.334061 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334010    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qhbjq\""
Jul 08 16:06:15.334234 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 16:06:15.334342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334245    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 16:06:15.334342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334292    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 16:06:15.334342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-642qkd1avpot1\""
Jul 08 16:06:15.334342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334295    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 16:06:15.334554 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.334357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 16:06:15.335106 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.335089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 16:06:15.338215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.338189    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 16:06:15.340396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.340371    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:15.340811 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.340796    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 16:06:15.405401 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-config-out\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-web-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vswz7\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-kube-api-access-vswz7\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.405979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.406208 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.405994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506298 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.506589 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vswz7\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-kube-api-access-vswz7\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-config-out\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-web-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.506970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507280    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507839    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.507990 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.507928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.508517 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.508490    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.510924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.510220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32d08e7d-c260-417e-83c6-f6ea32403732-config-out\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.510924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.510409    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.510965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511056    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-web-config\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511523    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.511950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32d08e7d-c260-417e-83c6-f6ea32403732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.512195 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.511977    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.512195 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.512113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.512449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.512425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.512946 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.512928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32d08e7d-c260-417e-83c6-f6ea32403732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.515213 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.515197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vswz7\" (UniqueName: \"kubernetes.io/projected/32d08e7d-c260-417e-83c6-f6ea32403732-kube-api-access-vswz7\") pod \"prometheus-k8s-0\" (UID: \"32d08e7d-c260-417e-83c6-f6ea32403732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.641324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.641288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:06:15.801006 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:15.800926    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:06:15.803906 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:06:15.803879    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d08e7d_c260_417e_83c6_f6ea32403732.slice/crio-802d4a20f3386bd1ce48db45d1cfa56223358212b604eef21b84070eb6516894 WatchSource:0}: Error finding container 802d4a20f3386bd1ce48db45d1cfa56223358212b604eef21b84070eb6516894: Status 404 returned error can't find the container with id 802d4a20f3386bd1ce48db45d1cfa56223358212b604eef21b84070eb6516894
Jul 08 16:06:16.267793 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:16.267763    2562 generic.go:356] "Generic (PLEG): container finished" podID="32d08e7d-c260-417e-83c6-f6ea32403732" containerID="97b82f0854d4ee83072f545760cffe6d2050b6769f98d299c3b199ba7b3e0a76" exitCode=0
Jul 08 16:06:16.267966 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:16.267810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerDied","Data":"97b82f0854d4ee83072f545760cffe6d2050b6769f98d299c3b199ba7b3e0a76"}
Jul 08 16:06:16.267966 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:16.267879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"802d4a20f3386bd1ce48db45d1cfa56223358212b604eef21b84070eb6516894"}
Jul 08 16:06:16.554691 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:16.554657    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6a425d-0c6e-42ee-9ff0-d5dff6b1d277" path="/var/lib/kubelet/pods/da6a425d-0c6e-42ee-9ff0-d5dff6b1d277/volumes"
Jul 08 16:06:17.274185 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"d714020f8a85ee2b151e935044ef602cb23013ddca7e293f12e2097dd8a0bbe6"}
Jul 08 16:06:17.274396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"bb82b6dba2248bcef1bf95a94d3255cf1fa4103a1066969e1eb90d6207edbc8b"}
Jul 08 16:06:17.274396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"0e64e880b8a32ffaa05b46153a1667111eb9d2fa8af0deb78b948d76bd3e6808"}
Jul 08 16:06:17.274396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"d680671a4855a3522ffd3a589060317eb5847e393e71182aac9bd26f3024fed6"}
Jul 08 16:06:17.274396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"b964468e2d26ffffc4d2cef01107725f691c0fdb8c7898b7bccf379188193205"}
Jul 08 16:06:17.274396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.274386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32d08e7d-c260-417e-83c6-f6ea32403732","Type":"ContainerStarted","Data":"131cb9de3361cf9088801227d93b2bea50e148be6addffdff6066a8bc3f63d75"}
Jul 08 16:06:17.340395 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:17.340341    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.32136204 podStartE2EDuration="2.340323624s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.961584ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:17.33853301 +0000 UTC m=+145.476057958" watchObservedRunningTime="2026-07-08 16:06:17.340323624 +0000 UTC m=+145.477848571"
Jul 08 16:06:20.641544 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:06:20.641506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:07:15.641543 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:07:15.641492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:07:15.656816 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:07:15.656789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:07:16.496765 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:07:16.496740    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:08:12.352046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.352014    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"]
Jul 08 16:08:12.355256 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.355239    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.358036 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.357954    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 16:08:12.359644 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.358579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fb7xr\""
Jul 08 16:08:12.359644 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.358847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:08:12.366207 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.366186    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"]
Jul 08 16:08:12.522763 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.522729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p4wc\" (UniqueName: \"kubernetes.io/projected/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-kube-api-access-9p4wc\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.522953 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.522784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-tmp\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.623619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.623534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-tmp\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.623774 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.623696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p4wc\" (UniqueName: \"kubernetes.io/projected/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-kube-api-access-9p4wc\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.623921 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.623902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-tmp\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.631788 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.631758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p4wc\" (UniqueName: \"kubernetes.io/projected/d1544a76-dd4b-4bef-bc5a-459fd56bfbda-kube-api-access-9p4wc\") pod \"openshift-lws-operator-fd8ccff4c-44xvl\" (UID: \"d1544a76-dd4b-4bef-bc5a-459fd56bfbda\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.682941 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.682911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"
Jul 08 16:08:12.804817 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:12.804795    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl"]
Jul 08 16:08:12.807340 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:08:12.807313    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1544a76_dd4b_4bef_bc5a_459fd56bfbda.slice/crio-65c339aaf20940968bce7239618fc467a13a9cdde83959dd8f4c0801470bef62 WatchSource:0}: Error finding container 65c339aaf20940968bce7239618fc467a13a9cdde83959dd8f4c0801470bef62: Status 404 returned error can't find the container with id 65c339aaf20940968bce7239618fc467a13a9cdde83959dd8f4c0801470bef62
Jul 08 16:08:13.678712 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:13.678620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl" event={"ID":"d1544a76-dd4b-4bef-bc5a-459fd56bfbda","Type":"ContainerStarted","Data":"65c339aaf20940968bce7239618fc467a13a9cdde83959dd8f4c0801470bef62"}
Jul 08 16:08:15.687365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:15.687333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl" event={"ID":"d1544a76-dd4b-4bef-bc5a-459fd56bfbda","Type":"ContainerStarted","Data":"908f2386dda1a5f8645ae25c9f8658a49e84799e35f3d4f18524f9a75b5f2f6f"}
Jul 08 16:08:15.707155 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:15.707103    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-44xvl" podStartSLOduration=1.264155494 podStartE2EDuration="3.707082936s" totalImagesPullingTime="2.442927442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:15.705748535 +0000 UTC m=+263.843273480" watchObservedRunningTime="2026-07-08 16:08:15.707082936 +0000 UTC m=+263.844607884"
Jul 08 16:08:34.188619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.188580    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"]
Jul 08 16:08:34.192021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.192005    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.194638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.194612    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"]
Jul 08 16:08:34.196391 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.196352    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 16:08:34.196765 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.196747    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 16:08:34.196940 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.196914    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 16:08:34.197029 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.197017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gr2cb\""
Jul 08 16:08:34.198115 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.198091    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 16:08:34.289507 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.289480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.289675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.289514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.289675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.289542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxhc\" (UniqueName: \"kubernetes.io/projected/01002223-7974-455d-8452-a7da026fcc97-kube-api-access-5pxhc\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.289675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.289620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.289675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.289640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.390994 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.390951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.391177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.391011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.391177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.391059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxhc\" (UniqueName: \"kubernetes.io/projected/01002223-7974-455d-8452-a7da026fcc97-kube-api-access-5pxhc\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.391177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.391095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.391177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.391119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.391522 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.391502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.393442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.393419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01002223-7974-455d-8452-a7da026fcc97-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.393548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.393498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.393548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.393500    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01002223-7974-455d-8452-a7da026fcc97-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.399818 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.399793    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxhc\" (UniqueName: \"kubernetes.io/projected/01002223-7974-455d-8452-a7da026fcc97-kube-api-access-5pxhc\") pod \"opendatahub-operator-controller-manager-bf8d94745-77bmf\" (UID: \"01002223-7974-455d-8452-a7da026fcc97\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.502911 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.502832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:34.631130 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.631098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"]
Jul 08 16:08:34.634409 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:08:34.634385    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01002223_7974_455d_8452_a7da026fcc97.slice/crio-fdc98b49fa9c05d0f330c552922ed7710697b30f96d834eba2100ed5b02537db WatchSource:0}: Error finding container fdc98b49fa9c05d0f330c552922ed7710697b30f96d834eba2100ed5b02537db: Status 404 returned error can't find the container with id fdc98b49fa9c05d0f330c552922ed7710697b30f96d834eba2100ed5b02537db
Jul 08 16:08:34.755307 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:34.755225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf" event={"ID":"01002223-7974-455d-8452-a7da026fcc97","Type":"ContainerStarted","Data":"fdc98b49fa9c05d0f330c552922ed7710697b30f96d834eba2100ed5b02537db"}
Jul 08 16:08:38.771116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:38.771080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf" event={"ID":"01002223-7974-455d-8452-a7da026fcc97","Type":"ContainerStarted","Data":"b3880868f729b1a68633f3c6e61840f46d268debbb7e1c007c0a8389622e3e17"}
Jul 08 16:08:39.776484 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:39.776452    2562 generic.go:356] "Generic (PLEG): container finished" podID="01002223-7974-455d-8452-a7da026fcc97" containerID="b3880868f729b1a68633f3c6e61840f46d268debbb7e1c007c0a8389622e3e17" exitCode=0
Jul 08 16:08:39.776971 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:39.776504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf" event={"ID":"01002223-7974-455d-8452-a7da026fcc97","Type":"ContainerDied","Data":"b3880868f729b1a68633f3c6e61840f46d268debbb7e1c007c0a8389622e3e17"}
Jul 08 16:08:41.790623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:41.790588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf" event={"ID":"01002223-7974-455d-8452-a7da026fcc97","Type":"ContainerStarted","Data":"29b00eca3e61e4eb1d750277c25c18f2a2adee0ba2468864b3d1204e17022c08"}
Jul 08 16:08:41.791007 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:41.790709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:41.817343 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:41.817288    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf" podStartSLOduration=2.218320251 podStartE2EDuration="7.817271929s" totalImagesPullingTime="4.561671776s" totalInitContainerRuntime="1.037279902s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:41.816871254 +0000 UTC m=+289.954396195" watchObservedRunningTime="2026-07-08 16:08:41.817271929 +0000 UTC m=+289.954796994"
Jul 08 16:08:52.349335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:52.349307    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 16:08:52.796617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:52.796538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-77bmf"
Jul 08 16:08:55.269262 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.269230    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"]
Jul 08 16:08:55.271435 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.271417    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.274970 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.274947    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 16:08:55.275082 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.274966    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-87kst\""
Jul 08 16:08:55.275082 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.275015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 16:08:55.275082 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.274972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 16:08:55.275569 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.275541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 16:08:55.294429 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.294404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"]
Jul 08 16:08:55.376474 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.376446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86vbv\" (UniqueName: \"kubernetes.io/projected/c025ace5-5264-44fd-bf58-402f8f226d21-kube-api-access-86vbv\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.376620 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.376483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.376620 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.376505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025ace5-5264-44fd-bf58-402f8f226d21-tmp\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.380556 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.380531    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pw9x"]
Jul 08 16:08:55.382510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.382497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.384667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.384642    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 16:08:55.384783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.384772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zqggv\""
Jul 08 16:08:55.394168 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.394147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pw9x"]
Jul 08 16:08:55.477826 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.477795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.478003 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.477832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025ace5-5264-44fd-bf58-402f8f226d21-tmp\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.478003 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.477891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a7ad31-5b79-43ae-a45a-61e00355f387-cert\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.478003 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.477937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5gjk\" (UniqueName: \"kubernetes.io/projected/39a7ad31-5b79-43ae-a45a-61e00355f387-kube-api-access-k5gjk\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.478003 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:08:55.477955    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 16:08:55.478003 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.477970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86vbv\" (UniqueName: \"kubernetes.io/projected/c025ace5-5264-44fd-bf58-402f8f226d21-kube-api-access-86vbv\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.478176 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:08:55.478026    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs podName:c025ace5-5264-44fd-bf58-402f8f226d21 nodeName:}" failed. No retries permitted until 2026-07-08 16:08:55.978009814 +0000 UTC m=+304.115534743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs") pod "kube-auth-proxy-6bddc7bb64-hfnwn" (UID: "c025ace5-5264-44fd-bf58-402f8f226d21") : secret "kube-auth-proxy-tls" not found
Jul 08 16:08:55.479970 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.479942    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025ace5-5264-44fd-bf58-402f8f226d21-tmp\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.487544 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.487521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86vbv\" (UniqueName: \"kubernetes.io/projected/c025ace5-5264-44fd-bf58-402f8f226d21-kube-api-access-86vbv\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.579260 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.579222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a7ad31-5b79-43ae-a45a-61e00355f387-cert\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.579432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.579295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5gjk\" (UniqueName: \"kubernetes.io/projected/39a7ad31-5b79-43ae-a45a-61e00355f387-kube-api-access-k5gjk\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.581477 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.581455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a7ad31-5b79-43ae-a45a-61e00355f387-cert\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.587416 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.587395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5gjk\" (UniqueName: \"kubernetes.io/projected/39a7ad31-5b79-43ae-a45a-61e00355f387-kube-api-access-k5gjk\") pod \"odh-model-controller-7998c67dc4-9pw9x\" (UID: \"39a7ad31-5b79-43ae-a45a-61e00355f387\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.692053 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.692025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:55.820979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.820943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pw9x"]
Jul 08 16:08:55.823596 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:08:55.823569    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a7ad31_5b79_43ae_a45a_61e00355f387.slice/crio-52b2c607480ead86e28d085c89a045b1f2f5d99771cc3faeec566a9aa99e5f1a WatchSource:0}: Error finding container 52b2c607480ead86e28d085c89a045b1f2f5d99771cc3faeec566a9aa99e5f1a: Status 404 returned error can't find the container with id 52b2c607480ead86e28d085c89a045b1f2f5d99771cc3faeec566a9aa99e5f1a
Jul 08 16:08:55.825013 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.824993    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:08:55.845869 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.845795    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x" event={"ID":"39a7ad31-5b79-43ae-a45a-61e00355f387","Type":"ContainerStarted","Data":"52b2c607480ead86e28d085c89a045b1f2f5d99771cc3faeec566a9aa99e5f1a"}
Jul 08 16:08:55.983146 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.983111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:55.985450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:55.985432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c025ace5-5264-44fd-bf58-402f8f226d21-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-hfnwn\" (UID: \"c025ace5-5264-44fd-bf58-402f8f226d21\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:56.181534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:56.181440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"
Jul 08 16:08:56.318580 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:56.318543    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn"]
Jul 08 16:08:56.321151 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:08:56.321121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc025ace5_5264_44fd_bf58_402f8f226d21.slice/crio-274e116b6e12901ee04a0889b0c0034416e10776f91e1c9ea59c492b85fa0b2f WatchSource:0}: Error finding container 274e116b6e12901ee04a0889b0c0034416e10776f91e1c9ea59c492b85fa0b2f: Status 404 returned error can't find the container with id 274e116b6e12901ee04a0889b0c0034416e10776f91e1c9ea59c492b85fa0b2f
Jul 08 16:08:56.855413 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:56.855376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn" event={"ID":"c025ace5-5264-44fd-bf58-402f8f226d21","Type":"ContainerStarted","Data":"274e116b6e12901ee04a0889b0c0034416e10776f91e1c9ea59c492b85fa0b2f"}
Jul 08 16:08:59.870340 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:59.870299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x" event={"ID":"39a7ad31-5b79-43ae-a45a-61e00355f387","Type":"ContainerStarted","Data":"b104e20848a3f4bddb878ac0959b5b1831e6558880ee2c43303a19c50e44ffc7"}
Jul 08 16:08:59.870807 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:59.870394    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:08:59.886048 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:08:59.885988    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x" podStartSLOduration=1.2901277850000001 podStartE2EDuration="4.885967038s" totalImagesPullingTime="3.595839253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:59.884936529 +0000 UTC m=+308.022461482" watchObservedRunningTime="2026-07-08 16:08:59.885967038 +0000 UTC m=+308.023492057"
Jul 08 16:09:00.875876 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:00.875831    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn" event={"ID":"c025ace5-5264-44fd-bf58-402f8f226d21","Type":"ContainerStarted","Data":"182bb5973d2b0c9a732107b42388490c1231a01e04462804ff9069ae856e049b"}
Jul 08 16:09:00.893865 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:00.893805    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-hfnwn" podStartSLOduration=2.043661429 podStartE2EDuration="5.893790528s" totalImagesPullingTime="3.850129099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:00.892754805 +0000 UTC m=+309.030279753" watchObservedRunningTime="2026-07-08 16:09:00.893790528 +0000 UTC m=+309.031315476"
Jul 08 16:09:02.614305 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.614264    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"]
Jul 08 16:09:02.617673 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.617649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.620232 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.620211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 16:09:02.620232 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.620219    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 16:09:02.620422 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.620246    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 16:09:02.620422 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.620267    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 16:09:02.620676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.620652    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w5x4s\""
Jul 08 16:09:02.630090 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.630069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"]
Jul 08 16:09:02.743928 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.743893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.743945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.743984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.744021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.744038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.744076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.744191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.744104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4nz\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-kube-api-access-fq4nz\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845405 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845581 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.845867 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.845583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4nz\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-kube-api-access-fq4nz\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.846173 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.846151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.847849 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.847825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.848043 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.848014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.848174 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.848157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.848306 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.848282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.855042 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.855016    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4nz\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-kube-api-access-fq4nz\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.857277 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.857257    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4d0ebc-4dcd-498e-bcae-11afc23063aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l6c5d\" (UID: \"5f4d0ebc-4dcd-498e-bcae-11afc23063aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.926624 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.926540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:02.964624 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.964592    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"]
Jul 08 16:09:02.968565 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.968537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:02.971337 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.971314    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 16:09:02.971877 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.971846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 16:09:02.971970 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.971846    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 16:09:02.973821 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.972672    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d5gqg\""
Jul 08 16:09:02.981664 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:02.981634    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"]
Jul 08 16:09:03.071738 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.071709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"]
Jul 08 16:09:03.074315 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:09:03.074289    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4d0ebc_4dcd_498e_bcae_11afc23063aa.slice/crio-d2fb92fbaddc6df32bc9007c0c4395b44b3b3b6ff90e21a6339c4e3230ff4ac4 WatchSource:0}: Error finding container d2fb92fbaddc6df32bc9007c0c4395b44b3b3b6ff90e21a6339c4e3230ff4ac4: Status 404 returned error can't find the container with id d2fb92fbaddc6df32bc9007c0c4395b44b3b3b6ff90e21a6339c4e3230ff4ac4
Jul 08 16:09:03.148597 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.148551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-manager-config\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.148597 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.148593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqhq\" (UniqueName: \"kubernetes.io/projected/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-kube-api-access-9mqhq\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.148850 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.148732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-metrics-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.148850 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.148773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.249997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.249905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-manager-config\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.249997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.249956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqhq\" (UniqueName: \"kubernetes.io/projected/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-kube-api-access-9mqhq\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.250187 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.250017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-metrics-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.250187 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.250036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.250563 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.250535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-manager-config\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.252412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.252389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.252512 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.252452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-metrics-cert\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.259805 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.259775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqhq\" (UniqueName: \"kubernetes.io/projected/c1dd1ac1-bc20-437e-adce-b8bd4c680a94-kube-api-access-9mqhq\") pod \"lws-controller-manager-7bf555d8d4-5fgxb\" (UID: \"c1dd1ac1-bc20-437e-adce-b8bd4c680a94\") " pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.287534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.287511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:03.416144 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.416118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"]
Jul 08 16:09:03.418380 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:09:03.418355    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dd1ac1_bc20_437e_adce_b8bd4c680a94.slice/crio-9d1f626bc04e203a3f80520e58a3b6944025d76813893a86878c56e485f3bde4 WatchSource:0}: Error finding container 9d1f626bc04e203a3f80520e58a3b6944025d76813893a86878c56e485f3bde4: Status 404 returned error can't find the container with id 9d1f626bc04e203a3f80520e58a3b6944025d76813893a86878c56e485f3bde4
Jul 08 16:09:03.888585 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.888555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb" event={"ID":"c1dd1ac1-bc20-437e-adce-b8bd4c680a94","Type":"ContainerStarted","Data":"9d1f626bc04e203a3f80520e58a3b6944025d76813893a86878c56e485f3bde4"}
Jul 08 16:09:03.889690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:03.889667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d" event={"ID":"5f4d0ebc-4dcd-498e-bcae-11afc23063aa","Type":"ContainerStarted","Data":"d2fb92fbaddc6df32bc9007c0c4395b44b3b3b6ff90e21a6339c4e3230ff4ac4"}
Jul 08 16:09:05.901761 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:05.901726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb" event={"ID":"c1dd1ac1-bc20-437e-adce-b8bd4c680a94","Type":"ContainerStarted","Data":"7444270dda8f10717c92ead57771cf521aec9b5e17263c45cb45d38c67db5b18"}
Jul 08 16:09:05.902156 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:05.901830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:09:05.968846 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:05.968798    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb" podStartSLOduration=1.6003370590000001 podStartE2EDuration="3.968779244s" totalImagesPullingTime="2.368442185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:05.967026229 +0000 UTC m=+314.104551175" watchObservedRunningTime="2026-07-08 16:09:05.968779244 +0000 UTC m=+314.106304192"
Jul 08 16:09:06.792533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:06.792475    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:09:06.792664 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:06.792567    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:09:06.909083 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:06.909049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d" event={"ID":"5f4d0ebc-4dcd-498e-bcae-11afc23063aa","Type":"ContainerStarted","Data":"29737578bbb1b1cc98dae16272ae3f49e2fe5144bb6c94f6a5425f0a55a79cf7"}
Jul 08 16:09:06.929947 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:06.929900    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d" podStartSLOduration=1.214032413 podStartE2EDuration="4.929883294s" totalImagesPullingTime="3.715850881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:06.929661755 +0000 UTC m=+315.067186704" watchObservedRunningTime="2026-07-08 16:09:06.929883294 +0000 UTC m=+315.067408241"
Jul 08 16:09:07.913307 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:07.913274    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:07.915004 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:07.914984    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l6c5d"
Jul 08 16:09:10.878561 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:10.878535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9pw9x"
Jul 08 16:09:16.911288 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:09:16.911255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bf555d8d4-5fgxb"
Jul 08 16:15:00.142908 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.142874    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:15:00.146317 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.146297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:15:00.148686 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.148666    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:15:00.148790 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.148688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:15:00.149448 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.149433    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:15:00.155827 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.155801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:15:00.260311 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.260277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnc74\" (UniqueName: \"kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74\") pod \"maas-api-key-cleanup-29725455-ptkzk\" (UID: \"5200b058-da06-4358-a921-2ead57d879f2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:15:00.361033 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.361000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnc74\" (UniqueName: \"kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74\") pod \"maas-api-key-cleanup-29725455-ptkzk\" (UID: \"5200b058-da06-4358-a921-2ead57d879f2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:15:00.370267 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.370234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnc74\" (UniqueName: \"kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74\") pod \"maas-api-key-cleanup-29725455-ptkzk\" (UID: \"5200b058-da06-4358-a921-2ead57d879f2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:15:00.457362 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.457273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:15:00.584332 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.584298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:15:00.587195 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:15:00.587157    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5200b058_da06_4358_a921_2ead57d879f2.slice/crio-b2beb87c7d8cf2450ab71f6d2faf60c5398703c6c335302a9afe8422357fe2fd WatchSource:0}: Error finding container b2beb87c7d8cf2450ab71f6d2faf60c5398703c6c335302a9afe8422357fe2fd: Status 404 returned error can't find the container with id b2beb87c7d8cf2450ab71f6d2faf60c5398703c6c335302a9afe8422357fe2fd
Jul 08 16:15:00.588966 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:00.588946    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:15:01.331704 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:01.331670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" event={"ID":"5200b058-da06-4358-a921-2ead57d879f2","Type":"ContainerStarted","Data":"b2beb87c7d8cf2450ab71f6d2faf60c5398703c6c335302a9afe8422357fe2fd"}
Jul 08 16:15:03.342146 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:03.342111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" event={"ID":"5200b058-da06-4358-a921-2ead57d879f2","Type":"ContainerStarted","Data":"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"}
Jul 08 16:15:03.359540 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:15:03.359484    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" podStartSLOduration=1.098835283 podStartE2EDuration="3.359466052s" totalImagesPullingTime="2.260630769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:15:03.358211939 +0000 UTC m=+671.495736887" watchObservedRunningTime="2026-07-08 16:15:03.359466052 +0000 UTC m=+671.496990998"
Jul 08 16:16:00.009996 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:00.009920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:16:00.010485 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:00.010179    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" podUID="5200b058-da06-4358-a921-2ead57d879f2" containerName="cleanup" containerID="cri-o://c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9" gracePeriod=30
Jul 08 16:16:30.181034 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.181003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:16:30.312770 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.312744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnc74\" (UniqueName: \"kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74\") pod \"5200b058-da06-4358-a921-2ead57d879f2\" (UID: \"5200b058-da06-4358-a921-2ead57d879f2\") "
Jul 08 16:16:30.314873 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.314831    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74" (OuterVolumeSpecName: "kube-api-access-dnc74") pod "5200b058-da06-4358-a921-2ead57d879f2" (UID: "5200b058-da06-4358-a921-2ead57d879f2"). InnerVolumeSpecName "kube-api-access-dnc74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:16:30.413351 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.413320    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnc74\" (UniqueName: \"kubernetes.io/projected/5200b058-da06-4358-a921-2ead57d879f2-kube-api-access-dnc74\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:16:30.704666 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.704582    2562 generic.go:356] "Generic (PLEG): container finished" podID="5200b058-da06-4358-a921-2ead57d879f2" containerID="c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9" exitCode=137
Jul 08 16:16:30.704666 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.704626    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"
Jul 08 16:16:30.704666 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.704643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" event={"ID":"5200b058-da06-4358-a921-2ead57d879f2","Type":"ContainerDied","Data":"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"}
Jul 08 16:16:30.705021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.704693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk" event={"ID":"5200b058-da06-4358-a921-2ead57d879f2","Type":"ContainerDied","Data":"b2beb87c7d8cf2450ab71f6d2faf60c5398703c6c335302a9afe8422357fe2fd"}
Jul 08 16:16:30.705021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.704714    2562 scope.go:117] "RemoveContainer" containerID="c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"
Jul 08 16:16:30.712570 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.712552    2562 scope.go:117] "RemoveContainer" containerID="c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"
Jul 08 16:16:30.712847 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:16:30.712830    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9\": container with ID starting with c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9 not found: ID does not exist" containerID="c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"
Jul 08 16:16:30.712927 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.712875    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9"} err="failed to get container status \"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9\": rpc error: code = NotFound desc = could not find container \"c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9\": container with ID starting with c2b915612f1bcada22877eaa6725d23cb3776398f325874cfbdb1cc7b639f4d9 not found: ID does not exist"
Jul 08 16:16:30.720636 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.720613    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:16:30.724535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:30.724511    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-ptkzk"]
Jul 08 16:16:32.552940 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:16:32.552908    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5200b058-da06-4358-a921-2ead57d879f2" path="/var/lib/kubelet/pods/5200b058-da06-4358-a921-2ead57d879f2/volumes"
Jul 08 16:28:44.450139 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.450107    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:44.450653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.450412    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5200b058-da06-4358-a921-2ead57d879f2" containerName="cleanup"
Jul 08 16:28:44.450653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.450424    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5200b058-da06-4358-a921-2ead57d879f2" containerName="cleanup"
Jul 08 16:28:44.450653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.450493    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5200b058-da06-4358-a921-2ead57d879f2" containerName="cleanup"
Jul 08 16:28:44.453037 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.453022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.456100 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.456077    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dbe3d898-serving-cert\""
Jul 08 16:28:44.456263 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.456245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:28:44.457088 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.457070    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:28:44.457177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.457101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:28:44.470235 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.470215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:44.561301 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.561272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.561301 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.561303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfs7f\" (UniqueName: \"kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.561693 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.561324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.662251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.662216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.662251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.662256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfs7f\" (UniqueName: \"kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.662504 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.662274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.663097 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.663076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.664705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.664683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.672927 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.672903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfs7f\" (UniqueName: \"kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f\") pod \"maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.763727 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.763640    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:44.898113 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.898084    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:44.900668 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:28:44.900630    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94b27ae_e13b_4a68_9c35_60c6bd941747.slice/crio-932afd713a49160f911a695607cd1b5d2f88742c2b1171c239e385bdf02ba8d0 WatchSource:0}: Error finding container 932afd713a49160f911a695607cd1b5d2f88742c2b1171c239e385bdf02ba8d0: Status 404 returned error can't find the container with id 932afd713a49160f911a695607cd1b5d2f88742c2b1171c239e385bdf02ba8d0
Jul 08 16:28:44.901887 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:44.901845    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:28:45.693180 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:45.693130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" event={"ID":"b94b27ae-e13b-4a68-9c35-60c6bd941747","Type":"ContainerStarted","Data":"932afd713a49160f911a695607cd1b5d2f88742c2b1171c239e385bdf02ba8d0"}
Jul 08 16:28:47.705073 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:47.704971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" event={"ID":"b94b27ae-e13b-4a68-9c35-60c6bd941747","Type":"ContainerStarted","Data":"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"}
Jul 08 16:28:47.705446 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:47.705072    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:47.728403 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:47.728342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" podStartSLOduration=1.251653885 podStartE2EDuration="3.728321002s" totalImagesPullingTime="2.476667117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:28:47.7268406 +0000 UTC m=+1495.864365550" watchObservedRunningTime="2026-07-08 16:28:47.728321002 +0000 UTC m=+1495.865845950"
Jul 08 16:28:49.919523 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:49.919490    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:49.920046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:49.919687    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" podUID="b94b27ae-e13b-4a68-9c35-60c6bd941747" containerName="maas-api" containerID="cri-o://6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f" gracePeriod=30
Jul 08 16:28:50.162950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.162926    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:50.315331 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.315304    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls\") pod \"b94b27ae-e13b-4a68-9c35-60c6bd941747\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") "
Jul 08 16:28:50.315509 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.315374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca\") pod \"b94b27ae-e13b-4a68-9c35-60c6bd941747\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") "
Jul 08 16:28:50.315509 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.315416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfs7f\" (UniqueName: \"kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f\") pod \"b94b27ae-e13b-4a68-9c35-60c6bd941747\" (UID: \"b94b27ae-e13b-4a68-9c35-60c6bd941747\") "
Jul 08 16:28:50.315726 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.315703    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b94b27ae-e13b-4a68-9c35-60c6bd941747" (UID: "b94b27ae-e13b-4a68-9c35-60c6bd941747"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:28:50.317461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.317433    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f" (OuterVolumeSpecName: "kube-api-access-mfs7f") pod "b94b27ae-e13b-4a68-9c35-60c6bd941747" (UID: "b94b27ae-e13b-4a68-9c35-60c6bd941747"). InnerVolumeSpecName "kube-api-access-mfs7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:28:50.317461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.317452    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b94b27ae-e13b-4a68-9c35-60c6bd941747" (UID: "b94b27ae-e13b-4a68-9c35-60c6bd941747"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:28:50.416226 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.416183    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfs7f\" (UniqueName: \"kubernetes.io/projected/b94b27ae-e13b-4a68-9c35-60c6bd941747-kube-api-access-mfs7f\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:28:50.416226 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.416223    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94b27ae-e13b-4a68-9c35-60c6bd941747-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:28:50.416226 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.416232    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94b27ae-e13b-4a68-9c35-60c6bd941747-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:28:50.718257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.718171    2562 generic.go:356] "Generic (PLEG): container finished" podID="b94b27ae-e13b-4a68-9c35-60c6bd941747" containerID="6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f" exitCode=0
Jul 08 16:28:50.718257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.718220    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"
Jul 08 16:28:50.718257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.718229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" event={"ID":"b94b27ae-e13b-4a68-9c35-60c6bd941747","Type":"ContainerDied","Data":"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"}
Jul 08 16:28:50.718525 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.718271    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w" event={"ID":"b94b27ae-e13b-4a68-9c35-60c6bd941747","Type":"ContainerDied","Data":"932afd713a49160f911a695607cd1b5d2f88742c2b1171c239e385bdf02ba8d0"}
Jul 08 16:28:50.718525 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.718292    2562 scope.go:117] "RemoveContainer" containerID="6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"
Jul 08 16:28:50.726360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.726342    2562 scope.go:117] "RemoveContainer" containerID="6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"
Jul 08 16:28:50.726613 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:28:50.726593    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f\": container with ID starting with 6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f not found: ID does not exist" containerID="6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"
Jul 08 16:28:50.726685 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.726621    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f"} err="failed to get container status \"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f\": rpc error: code = NotFound desc = could not find container \"6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f\": container with ID starting with 6a59f46668d8c0530ffdeeadad10ee8aa3ff377a0caacc61b3b517d3573a4c1f not found: ID does not exist"
Jul 08 16:28:50.735786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.735763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:50.740655 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:50.740633    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dbe3d898-69c7cbd754-zx56w"]
Jul 08 16:28:52.552344 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:52.552312    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b94b27ae-e13b-4a68-9c35-60c6bd941747" path="/var/lib/kubelet/pods/b94b27ae-e13b-4a68-9c35-60c6bd941747/volumes"
Jul 08 16:28:58.543930 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.543897    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:28:58.544397 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.544211    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94b27ae-e13b-4a68-9c35-60c6bd941747" containerName="maas-api"
Jul 08 16:28:58.544397 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.544221    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94b27ae-e13b-4a68-9c35-60c6bd941747" containerName="maas-api"
Jul 08 16:28:58.544397 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.544283    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94b27ae-e13b-4a68-9c35-60c6bd941747" containerName="maas-api"
Jul 08 16:28:58.548477 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.548451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.552390 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.552361    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bb93692f-serving-cert\""
Jul 08 16:28:58.552610 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.552597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:28:58.553198 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.553179    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:28:58.553294 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.553284    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:28:58.574010 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.573980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:28:58.583568 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.583539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.583700 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.583583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smhv\" (UniqueName: \"kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.583700 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.583692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.684946 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.684916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.685115 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.684953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smhv\" (UniqueName: \"kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.685115 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.684996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.685115 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:28:58.685088    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-serving-cert: secret "maas-api-e2e-ait-bb93692f-serving-cert" not found
Jul 08 16:28:58.685223 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:28:58.685145    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls podName:a3b07e13-2f60-424a-92bf-09d924773fd8 nodeName:}" failed. No retries permitted until 2026-07-08 16:28:59.185128052 +0000 UTC m=+1507.322652978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls") pod "maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" (UID: "a3b07e13-2f60-424a-92bf-09d924773fd8") : secret "maas-api-e2e-ait-bb93692f-serving-cert" not found
Jul 08 16:28:58.685609 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.685590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:58.704157 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:58.704129    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smhv\" (UniqueName: \"kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:59.190542 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:59.190511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:59.192949 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:59.192925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") pod \"maas-api-e2e-ait-bb93692f-746dff5644-w9qsn\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:59.459476 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:59.459401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:28:59.606486 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:59.606347    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:28:59.609250 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:28:59.609224    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b07e13_2f60_424a_92bf_09d924773fd8.slice/crio-64a113c3b32d7e23f1957561c8f29ba030c6a3f77a97bb222fed6b3e5363a3f0 WatchSource:0}: Error finding container 64a113c3b32d7e23f1957561c8f29ba030c6a3f77a97bb222fed6b3e5363a3f0: Status 404 returned error can't find the container with id 64a113c3b32d7e23f1957561c8f29ba030c6a3f77a97bb222fed6b3e5363a3f0
Jul 08 16:28:59.757254 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:28:59.757167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" event={"ID":"a3b07e13-2f60-424a-92bf-09d924773fd8","Type":"ContainerStarted","Data":"64a113c3b32d7e23f1957561c8f29ba030c6a3f77a97bb222fed6b3e5363a3f0"}
Jul 08 16:29:00.762918 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:00.762884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" event={"ID":"a3b07e13-2f60-424a-92bf-09d924773fd8","Type":"ContainerStarted","Data":"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"}
Jul 08 16:29:00.763396 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:00.762977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:29:00.782447 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:00.782397    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" podStartSLOduration=2.407506498 podStartE2EDuration="2.782381411s" totalImagesPullingTime="374.874913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:29:00.780877324 +0000 UTC m=+1508.918402268" watchObservedRunningTime="2026-07-08 16:29:00.782381411 +0000 UTC m=+1508.919906368"
Jul 08 16:29:04.211764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.211727    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:29:04.212196 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.211916    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" podUID="a3b07e13-2f60-424a-92bf-09d924773fd8" containerName="maas-api" containerID="cri-o://bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954" gracePeriod=30
Jul 08 16:29:04.456384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.456354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:29:04.536133 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.536060    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca\") pod \"a3b07e13-2f60-424a-92bf-09d924773fd8\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") "
Jul 08 16:29:04.536133 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.536101    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") pod \"a3b07e13-2f60-424a-92bf-09d924773fd8\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") "
Jul 08 16:29:04.536133 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.536128    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smhv\" (UniqueName: \"kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv\") pod \"a3b07e13-2f60-424a-92bf-09d924773fd8\" (UID: \"a3b07e13-2f60-424a-92bf-09d924773fd8\") "
Jul 08 16:29:04.536445 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.536421    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3b07e13-2f60-424a-92bf-09d924773fd8" (UID: "a3b07e13-2f60-424a-92bf-09d924773fd8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:29:04.538170 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.538149    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3b07e13-2f60-424a-92bf-09d924773fd8" (UID: "a3b07e13-2f60-424a-92bf-09d924773fd8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:29:04.538280 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.538191    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv" (OuterVolumeSpecName: "kube-api-access-4smhv") pod "a3b07e13-2f60-424a-92bf-09d924773fd8" (UID: "a3b07e13-2f60-424a-92bf-09d924773fd8"). InnerVolumeSpecName "kube-api-access-4smhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:29:04.637214 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.637178    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3b07e13-2f60-424a-92bf-09d924773fd8-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:04.637214 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.637208    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3b07e13-2f60-424a-92bf-09d924773fd8-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:04.637214 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.637216    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smhv\" (UniqueName: \"kubernetes.io/projected/a3b07e13-2f60-424a-92bf-09d924773fd8-kube-api-access-4smhv\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:04.779653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.779618    2562 generic.go:356] "Generic (PLEG): container finished" podID="a3b07e13-2f60-424a-92bf-09d924773fd8" containerID="bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954" exitCode=0
Jul 08 16:29:04.779816 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.779662    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"
Jul 08 16:29:04.779816 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.779712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" event={"ID":"a3b07e13-2f60-424a-92bf-09d924773fd8","Type":"ContainerDied","Data":"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"}
Jul 08 16:29:04.779816 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.779756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn" event={"ID":"a3b07e13-2f60-424a-92bf-09d924773fd8","Type":"ContainerDied","Data":"64a113c3b32d7e23f1957561c8f29ba030c6a3f77a97bb222fed6b3e5363a3f0"}
Jul 08 16:29:04.779816 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.779784    2562 scope.go:117] "RemoveContainer" containerID="bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"
Jul 08 16:29:04.787644 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.787628    2562 scope.go:117] "RemoveContainer" containerID="bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"
Jul 08 16:29:04.787919 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:29:04.787898    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954\": container with ID starting with bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954 not found: ID does not exist" containerID="bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"
Jul 08 16:29:04.788001 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.787925    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954"} err="failed to get container status \"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954\": rpc error: code = NotFound desc = could not find container \"bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954\": container with ID starting with bc4ae651debf11aeaba025030022ed0a9d8cbe86d6fd473cde8bd3bbdab00954 not found: ID does not exist"
Jul 08 16:29:04.804137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.804111    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:29:04.807838 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:04.807816    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb93692f-746dff5644-w9qsn"]
Jul 08 16:29:06.553758 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:06.553720    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b07e13-2f60-424a-92bf-09d924773fd8" path="/var/lib/kubelet/pods/a3b07e13-2f60-424a-92bf-09d924773fd8/volumes"
Jul 08 16:29:16.276384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.274064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:16.276384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.274724    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b07e13-2f60-424a-92bf-09d924773fd8" containerName="maas-api"
Jul 08 16:29:16.276384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.274744    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b07e13-2f60-424a-92bf-09d924773fd8" containerName="maas-api"
Jul 08 16:29:16.276384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.274942    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b07e13-2f60-424a-92bf-09d924773fd8" containerName="maas-api"
Jul 08 16:29:16.281076 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.281053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.284698 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.284679    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ac658b56-openshift-default-dockercfg-xthdl\""
Jul 08 16:29:16.290439 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.290402    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:16.339117 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339117 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2jtl\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.339530 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.339322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440592 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440592 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440827 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2jtl\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440827 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.440952 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.440971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441142 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.441118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441248 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.441185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441248 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.441204    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441414 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.441269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.441579 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.441559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.443195 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.443168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.443383 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.443364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.458417 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.458394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.464536 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.464516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2jtl\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl\") pod \"e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") " pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.591539 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.591506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:16.728330 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.728300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:16.730670 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:29:16.730644    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377907fc_1020_47d8_9aba_f497eb0315fb.slice/crio-4daddd5d4876f77d5772f25cb5302eef9247516b2560b41266aefb7ced8bca1a WatchSource:0}: Error finding container 4daddd5d4876f77d5772f25cb5302eef9247516b2560b41266aefb7ced8bca1a: Status 404 returned error can't find the container with id 4daddd5d4876f77d5772f25cb5302eef9247516b2560b41266aefb7ced8bca1a
Jul 08 16:29:16.831576 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:16.831542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" event={"ID":"377907fc-1020-47d8-9aba-f497eb0315fb","Type":"ContainerStarted","Data":"4daddd5d4876f77d5772f25cb5302eef9247516b2560b41266aefb7ced8bca1a"}
Jul 08 16:29:17.599366 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.599329    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:17.602924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.602897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.605645 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.605618    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ac658b56-serving-cert\""
Jul 08 16:29:17.605800 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.605624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:29:17.606497 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.606476    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:29:17.606917 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.606802    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:29:17.620950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.620914    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:17.757365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.757335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5br\" (UniqueName: \"kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.757365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.757376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.757629 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.757418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.858118 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.858030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5br\" (UniqueName: \"kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.858118 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.858075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.858364 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.858341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.859044 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.859018    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.860806 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.860784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.867412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.867368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5br\" (UniqueName: \"kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br\") pod \"maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:17.916283 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:17.916249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:18.094284 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:18.094025    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:18.097246 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:29:18.097217    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3c53a7_ad06_41af_bf47_845a5ad2e1d9.slice/crio-91ce55d989d563ba7d94e06ee88742b25bde69f92312403eeb1b7e036887f88a WatchSource:0}: Error finding container 91ce55d989d563ba7d94e06ee88742b25bde69f92312403eeb1b7e036887f88a: Status 404 returned error can't find the container with id 91ce55d989d563ba7d94e06ee88742b25bde69f92312403eeb1b7e036887f88a
Jul 08 16:29:18.842080 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:18.842040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" event={"ID":"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9","Type":"ContainerStarted","Data":"91ce55d989d563ba7d94e06ee88742b25bde69f92312403eeb1b7e036887f88a"}
Jul 08 16:29:19.408079 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.408036    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:29:19.408169 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.408126    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:29:19.408169 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.408157    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:29:19.848102 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.848065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" event={"ID":"377907fc-1020-47d8-9aba-f497eb0315fb","Type":"ContainerStarted","Data":"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"}
Jul 08 16:29:19.849422 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.849404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" event={"ID":"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9","Type":"ContainerStarted","Data":"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"}
Jul 08 16:29:19.849535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.849516    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:19.871606 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.871548    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" podStartSLOduration=1.196397338 podStartE2EDuration="3.871528618s" totalImagesPullingTime="2.67513128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:29:19.871210715 +0000 UTC m=+1528.008735665" watchObservedRunningTime="2026-07-08 16:29:19.871528618 +0000 UTC m=+1528.009053567"
Jul 08 16:29:19.889410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:19.889351    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" podStartSLOduration=1.581068096 podStartE2EDuration="2.889332398s" totalImagesPullingTime="1.308264302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:29:19.889087145 +0000 UTC m=+1528.026612107" watchObservedRunningTime="2026-07-08 16:29:19.889332398 +0000 UTC m=+1528.026857346"
Jul 08 16:29:20.592565 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:20.592534    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:20.597847 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:20.597822    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:20.853612 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:20.853537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:20.854534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:20.854515    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:22.051676 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.051640    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:22.305764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.305690    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:22.306001 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.305926    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" podUID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" containerName="maas-api" containerID="cri-o://7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff" gracePeriod=30
Jul 08 16:29:22.554297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.554273    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:22.703340 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.703309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx5br\" (UniqueName: \"kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br\") pod \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") "
Jul 08 16:29:22.703554 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.703365    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca\") pod \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") "
Jul 08 16:29:22.703554 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.703426    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls\") pod \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\" (UID: \"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9\") "
Jul 08 16:29:22.703776 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.703751    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" (UID: "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:29:22.705450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.705415    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" (UID: "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:29:22.705557 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.705470    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br" (OuterVolumeSpecName: "kube-api-access-kx5br") pod "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" (UID: "ae3c53a7-ad06-41af-bf47-845a5ad2e1d9"). InnerVolumeSpecName "kube-api-access-kx5br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:29:22.804186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.804149    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx5br\" (UniqueName: \"kubernetes.io/projected/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-kube-api-access-kx5br\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:22.804186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.804175    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:22.804186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.804188    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:22.863105 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863072    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" containerID="7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff" exitCode=0
Jul 08 16:29:22.863292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863114    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"
Jul 08 16:29:22.863292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" event={"ID":"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9","Type":"ContainerDied","Data":"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"}
Jul 08 16:29:22.863292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c" event={"ID":"ae3c53a7-ad06-41af-bf47-845a5ad2e1d9","Type":"ContainerDied","Data":"91ce55d989d563ba7d94e06ee88742b25bde69f92312403eeb1b7e036887f88a"}
Jul 08 16:29:22.863292 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863202    2562 scope.go:117] "RemoveContainer" containerID="7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"
Jul 08 16:29:22.863623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.863600    2562 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" secret="" err="secret \"e2e-derive-ac658b56-openshift-default-dockercfg-xthdl\" not found"
Jul 08 16:29:22.872158 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.872141    2562 scope.go:117] "RemoveContainer" containerID="7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"
Jul 08 16:29:22.872432 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:29:22.872407    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff\": container with ID starting with 7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff not found: ID does not exist" containerID="7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"
Jul 08 16:29:22.872490 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.872443    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff"} err="failed to get container status \"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff\": rpc error: code = NotFound desc = could not find container \"7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff\": container with ID starting with 7bdd9b37b7377d9c6b3eab98de22140ad76e3fb49e4b2f215e5ee70139f6bdff not found: ID does not exist"
Jul 08 16:29:22.887895 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.887866    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:22.890928 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:22.890906    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ac658b56-75b9dbd9cd-pqs7c"]
Jul 08 16:29:23.868773 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:23.868739    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" podUID="377907fc-1020-47d8-9aba-f497eb0315fb" containerName="istio-proxy" containerID="cri-o://9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581" gracePeriod=30
Jul 08 16:29:24.553038 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:24.553008    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" path="/var/lib/kubelet/pods/ae3c53a7-ad06-41af-bf47-845a5ad2e1d9/volumes"
Jul 08 16:29:29.106336 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.106313    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:29.262434 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262345    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262434 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262434 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262414    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262483    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262502    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262530    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2jtl\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.262690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket\") pod \"377907fc-1020-47d8-9aba-f497eb0315fb\" (UID: \"377907fc-1020-47d8-9aba-f497eb0315fb\") "
Jul 08 16:29:29.263042 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262763    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:29:29.263042 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.262970    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.263042 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.263015    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:29:29.263199 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.263037    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:29:29.263199 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.263169    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:29:29.263199 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.263187    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:29:29.264829 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.264798    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:29:29.264951 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.264841    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl" (OuterVolumeSpecName: "kube-api-access-g2jtl") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "kube-api-access-g2jtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:29:29.265019 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.264999    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:29:29.265069 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.265002    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "377907fc-1020-47d8-9aba-f497eb0315fb" (UID: "377907fc-1020-47d8-9aba-f497eb0315fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:29:29.363808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363772    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.363808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363801    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.363808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363810    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/377907fc-1020-47d8-9aba-f497eb0315fb-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.363808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363819    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/377907fc-1020-47d8-9aba-f497eb0315fb-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.364137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363827    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.364137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363834    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.364137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363843    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/377907fc-1020-47d8-9aba-f497eb0315fb-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.364137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.363875    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2jtl\" (UniqueName: \"kubernetes.io/projected/377907fc-1020-47d8-9aba-f497eb0315fb-kube-api-access-g2jtl\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:29:29.895148 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.895113    2562 generic.go:356] "Generic (PLEG): container finished" podID="377907fc-1020-47d8-9aba-f497eb0315fb" containerID="9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581" exitCode=0
Jul 08 16:29:29.895336 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.895156    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"
Jul 08 16:29:29.895336 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.895158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" event={"ID":"377907fc-1020-47d8-9aba-f497eb0315fb","Type":"ContainerDied","Data":"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"}
Jul 08 16:29:29.895336 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.895295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd" event={"ID":"377907fc-1020-47d8-9aba-f497eb0315fb","Type":"ContainerDied","Data":"4daddd5d4876f77d5772f25cb5302eef9247516b2560b41266aefb7ced8bca1a"}
Jul 08 16:29:29.895503 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.895339    2562 scope.go:117] "RemoveContainer" containerID="9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"
Jul 08 16:29:29.904247 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.904231    2562 scope.go:117] "RemoveContainer" containerID="9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"
Jul 08 16:29:29.904513 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:29:29.904493    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581\": container with ID starting with 9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581 not found: ID does not exist" containerID="9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"
Jul 08 16:29:29.904577 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.904525    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581"} err="failed to get container status \"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581\": rpc error: code = NotFound desc = could not find container \"9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581\": container with ID starting with 9acfa22ffae49c477b7e507b755b710560cc863946a2d0cf5a4869dbd2a0a581 not found: ID does not exist"
Jul 08 16:29:29.920845 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.920822    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:29.925687 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:29.925667    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ac658b56-openshift-default-6447d456b7-j8qnd"]
Jul 08 16:29:30.552909 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:29:30.552878    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377907fc-1020-47d8-9aba-f497eb0315fb" path="/var/lib/kubelet/pods/377907fc-1020-47d8-9aba-f497eb0315fb/volumes"
Jul 08 16:30:00.137336 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137298    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137599    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" containerName="maas-api"
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137611    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" containerName="maas-api"
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137630    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377907fc-1020-47d8-9aba-f497eb0315fb" containerName="istio-proxy"
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137636    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="377907fc-1020-47d8-9aba-f497eb0315fb" containerName="istio-proxy"
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137681    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3c53a7-ad06-41af-bf47-845a5ad2e1d9" containerName="maas-api"
Jul 08 16:30:00.137750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.137691    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="377907fc-1020-47d8-9aba-f497eb0315fb" containerName="istio-proxy"
Jul 08 16:30:00.145946 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.145928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:30:00.148533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.148504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:30:00.148726 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.148650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:30:00.148843 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.148649    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:30:00.149639 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.149621    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:30:00.230055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.230021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlnn\" (UniqueName: \"kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn\") pod \"maas-api-key-cleanup-29725470-wk4s2\" (UID: \"679d3c81-cac5-49c0-8b31-0d454c7f3ee5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:30:00.330883 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.330821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlnn\" (UniqueName: \"kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn\") pod \"maas-api-key-cleanup-29725470-wk4s2\" (UID: \"679d3c81-cac5-49c0-8b31-0d454c7f3ee5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:30:00.338755 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.338727    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlnn\" (UniqueName: \"kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn\") pod \"maas-api-key-cleanup-29725470-wk4s2\" (UID: \"679d3c81-cac5-49c0-8b31-0d454c7f3ee5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:30:00.456970 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.456891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:30:00.580834 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:00.580703    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:30:00.583044 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:30:00.583020    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679d3c81_cac5_49c0_8b31_0d454c7f3ee5.slice/crio-1b322d5d43190d3f1af25d6fd9a949e81cd376449c26cfe21e3bf2d5cee4b103 WatchSource:0}: Error finding container 1b322d5d43190d3f1af25d6fd9a949e81cd376449c26cfe21e3bf2d5cee4b103: Status 404 returned error can't find the container with id 1b322d5d43190d3f1af25d6fd9a949e81cd376449c26cfe21e3bf2d5cee4b103
Jul 08 16:30:01.030157 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:01.030114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" event={"ID":"679d3c81-cac5-49c0-8b31-0d454c7f3ee5","Type":"ContainerStarted","Data":"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"}
Jul 08 16:30:01.030320 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:01.030167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" event={"ID":"679d3c81-cac5-49c0-8b31-0d454c7f3ee5","Type":"ContainerStarted","Data":"1b322d5d43190d3f1af25d6fd9a949e81cd376449c26cfe21e3bf2d5cee4b103"}
Jul 08 16:30:01.047531 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:30:01.047436    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" podStartSLOduration=1.047419472 podStartE2EDuration="1.047419472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:01.046079787 +0000 UTC m=+1569.183604735" watchObservedRunningTime="2026-07-08 16:30:01.047419472 +0000 UTC m=+1569.184944418"
Jul 08 16:31:00.012580 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:00.012543    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:31:00.013105 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:00.012724    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" podUID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" containerName="cleanup" containerID="cri-o://a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff" gracePeriod=30
Jul 08 16:31:08.641128 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.641095    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:08.644454 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.644433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.647160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.647136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b2584c54-serving-cert\""
Jul 08 16:31:08.662776 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.662754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:08.804141 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.804106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.804141 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.804146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjl2\" (UniqueName: \"kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.804351 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.804242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.905796 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.905695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.905796 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.905761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.905796 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.905780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjl2\" (UniqueName: \"kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.906031 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:08.905944    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-serving-cert: secret "maas-api-e2e-mt-b2584c54-serving-cert" not found
Jul 08 16:31:08.906031 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:08.906019    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls podName:c4d4a9e8-564e-4295-b8aa-f8b612a2e456 nodeName:}" failed. No retries permitted until 2026-07-08 16:31:09.405996215 +0000 UTC m=+1637.543521157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls") pod "maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" (UID: "c4d4a9e8-564e-4295-b8aa-f8b612a2e456") : secret "maas-api-e2e-mt-b2584c54-serving-cert" not found
Jul 08 16:31:08.906491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.906471    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:08.915110 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:08.915088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjl2\" (UniqueName: \"kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:09.411046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:09.411005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:09.413460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:09.413441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") pod \"maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:09.554709 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:09.554671    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:09.684716 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:09.684692    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:09.686520 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:31:09.686492    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d4a9e8_564e_4295_b8aa_f8b612a2e456.slice/crio-af2b77260715ee475c9611e134d017d2e99bc12c50695dbebe01d832fb5e3f3d WatchSource:0}: Error finding container af2b77260715ee475c9611e134d017d2e99bc12c50695dbebe01d832fb5e3f3d: Status 404 returned error can't find the container with id af2b77260715ee475c9611e134d017d2e99bc12c50695dbebe01d832fb5e3f3d
Jul 08 16:31:10.323231 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:10.323188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" event={"ID":"c4d4a9e8-564e-4295-b8aa-f8b612a2e456","Type":"ContainerStarted","Data":"af2b77260715ee475c9611e134d017d2e99bc12c50695dbebe01d832fb5e3f3d"}
Jul 08 16:31:11.329046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:11.329007    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" event={"ID":"c4d4a9e8-564e-4295-b8aa-f8b612a2e456","Type":"ContainerStarted","Data":"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"}
Jul 08 16:31:11.329482 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:11.329124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:11.346631 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:11.346575    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" podStartSLOduration=2.3510786599999998 podStartE2EDuration="3.346556038s" totalImagesPullingTime="995.477378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:31:11.346306256 +0000 UTC m=+1639.483831205" watchObservedRunningTime="2026-07-08 16:31:11.346556038 +0000 UTC m=+1639.484080987"
Jul 08 16:31:17.339010 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:17.338979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:21.432219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.432186    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:21.432685 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.432416    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" podUID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" containerName="maas-api" containerID="cri-o://ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58" gracePeriod=30
Jul 08 16:31:21.673408 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.673384    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:21.822675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.822647    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca\") pod \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") "
Jul 08 16:31:21.822828 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.822697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") pod \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") "
Jul 08 16:31:21.822828 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.822746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjl2\" (UniqueName: \"kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2\") pod \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\" (UID: \"c4d4a9e8-564e-4295-b8aa-f8b612a2e456\") "
Jul 08 16:31:21.823047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.823025    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4d4a9e8-564e-4295-b8aa-f8b612a2e456" (UID: "c4d4a9e8-564e-4295-b8aa-f8b612a2e456"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:31:21.824808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.824783    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2" (OuterVolumeSpecName: "kube-api-access-xrjl2") pod "c4d4a9e8-564e-4295-b8aa-f8b612a2e456" (UID: "c4d4a9e8-564e-4295-b8aa-f8b612a2e456"). InnerVolumeSpecName "kube-api-access-xrjl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:21.824891 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.824795    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4d4a9e8-564e-4295-b8aa-f8b612a2e456" (UID: "c4d4a9e8-564e-4295-b8aa-f8b612a2e456"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:31:21.924312 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.924272    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjl2\" (UniqueName: \"kubernetes.io/projected/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-kube-api-access-xrjl2\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:31:21.924312 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.924307    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:31:21.924312 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:21.924320    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d4a9e8-564e-4295-b8aa-f8b612a2e456-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:31:22.377001 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.376965    2562 generic.go:356] "Generic (PLEG): container finished" podID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" containerID="ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58" exitCode=0
Jul 08 16:31:22.377468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.377184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" event={"ID":"c4d4a9e8-564e-4295-b8aa-f8b612a2e456","Type":"ContainerDied","Data":"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"}
Jul 08 16:31:22.377468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.377399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq" event={"ID":"c4d4a9e8-564e-4295-b8aa-f8b612a2e456","Type":"ContainerDied","Data":"af2b77260715ee475c9611e134d017d2e99bc12c50695dbebe01d832fb5e3f3d"}
Jul 08 16:31:22.377468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.377448    2562 scope.go:117] "RemoveContainer" containerID="ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"
Jul 08 16:31:22.382998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.377458    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"
Jul 08 16:31:22.391619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.391601    2562 scope.go:117] "RemoveContainer" containerID="ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"
Jul 08 16:31:22.391910 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:22.391883    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58\": container with ID starting with ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58 not found: ID does not exist" containerID="ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"
Jul 08 16:31:22.391983 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.391923    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58"} err="failed to get container status \"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58\": rpc error: code = NotFound desc = could not find container \"ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58\": container with ID starting with ed1c06f8aae25c2db66e688e50830045f7d3da232a14a154230d55fbae609f58 not found: ID does not exist"
Jul 08 16:31:22.401681 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.401653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:22.409885 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.409844    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2584c54-6f5b7956f5-fv2gq"]
Jul 08 16:31:22.552314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:22.552281    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" path="/var/lib/kubelet/pods/c4d4a9e8-564e-4295-b8aa-f8b612a2e456/volumes"
Jul 08 16:31:30.201491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.201466    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:31:30.293463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.293378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmlnn\" (UniqueName: \"kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn\") pod \"679d3c81-cac5-49c0-8b31-0d454c7f3ee5\" (UID: \"679d3c81-cac5-49c0-8b31-0d454c7f3ee5\") "
Jul 08 16:31:30.295412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.295386    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn" (OuterVolumeSpecName: "kube-api-access-cmlnn") pod "679d3c81-cac5-49c0-8b31-0d454c7f3ee5" (UID: "679d3c81-cac5-49c0-8b31-0d454c7f3ee5"). InnerVolumeSpecName "kube-api-access-cmlnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:30.394965 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.394933    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmlnn\" (UniqueName: \"kubernetes.io/projected/679d3c81-cac5-49c0-8b31-0d454c7f3ee5-kube-api-access-cmlnn\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:31:30.414382 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.414351    2562 generic.go:356] "Generic (PLEG): container finished" podID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" containerID="a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff" exitCode=137
Jul 08 16:31:30.414535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.414394    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"
Jul 08 16:31:30.414535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.414430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" event={"ID":"679d3c81-cac5-49c0-8b31-0d454c7f3ee5","Type":"ContainerDied","Data":"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"}
Jul 08 16:31:30.414535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.414482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2" event={"ID":"679d3c81-cac5-49c0-8b31-0d454c7f3ee5","Type":"ContainerDied","Data":"1b322d5d43190d3f1af25d6fd9a949e81cd376449c26cfe21e3bf2d5cee4b103"}
Jul 08 16:31:30.414535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.414504    2562 scope.go:117] "RemoveContainer" containerID="a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"
Jul 08 16:31:30.422828 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.422812    2562 scope.go:117] "RemoveContainer" containerID="a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"
Jul 08 16:31:30.423053 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:30.423037    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff\": container with ID starting with a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff not found: ID does not exist" containerID="a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"
Jul 08 16:31:30.423100 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.423062    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff"} err="failed to get container status \"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff\": rpc error: code = NotFound desc = could not find container \"a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff\": container with ID starting with a2b5706b8ad92324b48b264dbeaba30e9797150de9c18915e82c4d07729f18ff not found: ID does not exist"
Jul 08 16:31:30.435534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.435515    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:31:30.437438 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.437419    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-wk4s2"]
Jul 08 16:31:30.553286 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:30.553211    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" path="/var/lib/kubelet/pods/679d3c81-cac5-49c0-8b31-0d454c7f3ee5/volumes"
Jul 08 16:31:47.484627 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.484591    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:31:47.485114 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485049    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" containerName="maas-api"
Jul 08 16:31:47.485114 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485067    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" containerName="maas-api"
Jul 08 16:31:47.485114 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485099    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" containerName="cleanup"
Jul 08 16:31:47.485114 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485107    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" containerName="cleanup"
Jul 08 16:31:47.485312 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485185    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4d4a9e8-564e-4295-b8aa-f8b612a2e456" containerName="maas-api"
Jul 08 16:31:47.485312 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.485203    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="679d3c81-cac5-49c0-8b31-0d454c7f3ee5" containerName="cleanup"
Jul 08 16:31:47.489551 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.489529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.492183 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.492163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f66b739c-openshift-default-dockercfg-fpt6r\""
Jul 08 16:31:47.503545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.503520    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:31:47.543226 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543226 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w6jn\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543432 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543621 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543621 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.543621 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.543544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644526 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644813 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644813 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6jn\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644951 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.644951 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.644907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.645055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.645022    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.645179 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.645151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.645409 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.645388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.646708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.646688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.646936 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.646917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.653021 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.652995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.653572 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.653548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6jn\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn\") pod \"e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") " pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.799297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.799220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:47.934360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.934336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:31:47.937076 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:31:47.937049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bc633b_c980_4b77_a737_0b289f8d09ff.slice/crio-649f79ac2b18ae077f2bd8c0ebb29c3a60114689a9f3afd4b9d7a943966fab01 WatchSource:0}: Error finding container 649f79ac2b18ae077f2bd8c0ebb29c3a60114689a9f3afd4b9d7a943966fab01: Status 404 returned error can't find the container with id 649f79ac2b18ae077f2bd8c0ebb29c3a60114689a9f3afd4b9d7a943966fab01
Jul 08 16:31:47.939152 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.939122    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:31:47.939217 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.939182    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:31:47.939217 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:47.939209    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:31:48.492863 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:48.492816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerStarted","Data":"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"}
Jul 08 16:31:48.493315 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:48.492915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerStarted","Data":"649f79ac2b18ae077f2bd8c0ebb29c3a60114689a9f3afd4b9d7a943966fab01"}
Jul 08 16:31:48.514736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:48.514688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podStartSLOduration=1.5146732539999999 podStartE2EDuration="1.514673254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:31:48.513150885 +0000 UTC m=+1676.650675835" watchObservedRunningTime="2026-07-08 16:31:48.514673254 +0000 UTC m=+1676.652198200"
Jul 08 16:31:48.799654 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:48.799576    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:49.805109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:49.805077    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:50.502626 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.502588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:50.503617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.503595    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:31:50.621468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.621440    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:31:50.624577 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.624556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.626965 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.626938    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f66b739c-serving-cert\""
Jul 08 16:31:50.627077 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.626966    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:31:50.627077 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.627035    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:31:50.627077 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.627041    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:31:50.636527 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.636503    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:31:50.771420 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.771336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.771420 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.771392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzs7\" (UniqueName: \"kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.771631 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.771505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.872742 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.872694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzs7\" (UniqueName: \"kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.873251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.872758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.873251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.872813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.873251 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:50.872957    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-serving-cert: secret "maas-api-e2e-mt-f66b739c-serving-cert" not found
Jul 08 16:31:50.873251 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:31:50.873060    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls podName:9260b923-e6eb-4c8a-8526-049d11b5b3b3 nodeName:}" failed. No retries permitted until 2026-07-08 16:31:51.373025486 +0000 UTC m=+1679.510550422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls") pod "maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" (UID: "9260b923-e6eb-4c8a-8526-049d11b5b3b3") : secret "maas-api-e2e-mt-f66b739c-serving-cert" not found
Jul 08 16:31:50.873413 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.873377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:50.881145 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:50.881124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzs7\" (UniqueName: \"kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:51.378423 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:51.378382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:51.380838 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:51.380810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") pod \"maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:51.534933 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:51.534899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:51.664658 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:51.664533    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:31:51.668126 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:31:51.668093    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9260b923_e6eb_4c8a_8526_049d11b5b3b3.slice/crio-a09a640be1f2210f88729f7af9b7af4df64f805b1b8ef4ada5612e7373f180ff WatchSource:0}: Error finding container a09a640be1f2210f88729f7af9b7af4df64f805b1b8ef4ada5612e7373f180ff: Status 404 returned error can't find the container with id a09a640be1f2210f88729f7af9b7af4df64f805b1b8ef4ada5612e7373f180ff
Jul 08 16:31:52.511602 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:52.511569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" event={"ID":"9260b923-e6eb-4c8a-8526-049d11b5b3b3","Type":"ContainerStarted","Data":"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"}
Jul 08 16:31:52.512033 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:52.511616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" event={"ID":"9260b923-e6eb-4c8a-8526-049d11b5b3b3","Type":"ContainerStarted","Data":"a09a640be1f2210f88729f7af9b7af4df64f805b1b8ef4ada5612e7373f180ff"}
Jul 08 16:31:52.528779 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:52.528737    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" podStartSLOduration=1.765402572 podStartE2EDuration="2.528721814s" totalImagesPullingTime="763.319242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:31:52.527539232 +0000 UTC m=+1680.665064179" watchObservedRunningTime="2026-07-08 16:31:52.528721814 +0000 UTC m=+1680.666246760"
Jul 08 16:31:53.515528 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:53.515444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:31:59.525429 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:31:59.525389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:32:04.563376 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.563339    2562 generic.go:356] "Generic (PLEG): container finished" podID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerID="5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866" exitCode=0
Jul 08 16:32:04.563915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.563380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerDied","Data":"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"}
Jul 08 16:32:04.563915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.563872    2562 scope.go:117] "RemoveContainer" containerID="5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"
Jul 08 16:32:04.564950 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.564921    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:32:04.565053 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.565024    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:32:04.565113 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:04.565076    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:32:05.503101 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:05.503053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:32:05.569788 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:05.569750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerStarted","Data":"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"}
Jul 08 16:32:05.801258 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:05.801152    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:32:05.801433 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:05.801337    2562 patch_prober.go:28] interesting pod/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 08 16:32:05.801433 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:05.801419    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 08 16:32:06.800700 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:06.800655    2562 patch_prober.go:28] interesting pod/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 08 16:32:06.801202 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:06.800746    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 08 16:32:07.799896 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:07.799835    2562 patch_prober.go:28] interesting pod/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 08 16:32:07.800118 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:07.799938    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 08 16:32:08.799762 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:08.799715    2562 patch_prober.go:28] interesting pod/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 08 16:32:08.800287 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:08.799786    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 08 16:32:09.805126 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:09.805093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:32:09.805549 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:09.805377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:32:09.806112 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:09.806096    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:32:53.399849 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.399750    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:32:53.400384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.400011    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" podUID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" containerName="maas-api" containerID="cri-o://4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422" gracePeriod=30
Jul 08 16:32:53.647790 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.647768    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:32:53.769148 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.769060    2562 generic.go:356] "Generic (PLEG): container finished" podID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" containerID="4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422" exitCode=0
Jul 08 16:32:53.769148 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.769100    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"
Jul 08 16:32:53.769406 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.769143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" event={"ID":"9260b923-e6eb-4c8a-8526-049d11b5b3b3","Type":"ContainerDied","Data":"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"}
Jul 08 16:32:53.769406 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.769198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn" event={"ID":"9260b923-e6eb-4c8a-8526-049d11b5b3b3","Type":"ContainerDied","Data":"a09a640be1f2210f88729f7af9b7af4df64f805b1b8ef4ada5612e7373f180ff"}
Jul 08 16:32:53.769406 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.769227    2562 scope.go:117] "RemoveContainer" containerID="4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"
Jul 08 16:32:53.776842 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.776824    2562 scope.go:117] "RemoveContainer" containerID="4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"
Jul 08 16:32:53.777105 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:32:53.777084    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422\": container with ID starting with 4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422 not found: ID does not exist" containerID="4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"
Jul 08 16:32:53.777144 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.777115    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422"} err="failed to get container status \"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422\": rpc error: code = NotFound desc = could not find container \"4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422\": container with ID starting with 4843779ba44ef4e67b68706aa70a881e3b885f1b5c7e53aef1c2520fb9ce9422 not found: ID does not exist"
Jul 08 16:32:53.834254 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.834223    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") pod \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") "
Jul 08 16:32:53.834405 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.834259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca\") pod \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") "
Jul 08 16:32:53.834405 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.834289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqzs7\" (UniqueName: \"kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7\") pod \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\" (UID: \"9260b923-e6eb-4c8a-8526-049d11b5b3b3\") "
Jul 08 16:32:53.834682 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.834660    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9260b923-e6eb-4c8a-8526-049d11b5b3b3" (UID: "9260b923-e6eb-4c8a-8526-049d11b5b3b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:32:53.836343 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.836323    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7" (OuterVolumeSpecName: "kube-api-access-hqzs7") pod "9260b923-e6eb-4c8a-8526-049d11b5b3b3" (UID: "9260b923-e6eb-4c8a-8526-049d11b5b3b3"). InnerVolumeSpecName "kube-api-access-hqzs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:32:53.836415 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.836347    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9260b923-e6eb-4c8a-8526-049d11b5b3b3" (UID: "9260b923-e6eb-4c8a-8526-049d11b5b3b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:32:53.935736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.935703    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9260b923-e6eb-4c8a-8526-049d11b5b3b3-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:32:53.935736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.935729    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9260b923-e6eb-4c8a-8526-049d11b5b3b3-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:32:53.935736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:53.935738    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqzs7\" (UniqueName: \"kubernetes.io/projected/9260b923-e6eb-4c8a-8526-049d11b5b3b3-kube-api-access-hqzs7\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:32:54.090215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:54.090182    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:32:54.098281 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:54.098255    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f66b739c-7d44cffb58-ccbwn"]
Jul 08 16:32:54.552913 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:32:54.552832    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" path="/var/lib/kubelet/pods/9260b923-e6eb-4c8a-8526-049d11b5b3b3/volumes"
Jul 08 16:33:48.175248 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:48.175167    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:33:48.175708 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:48.175387    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy" containerID="cri-o://e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c" gracePeriod=30
Jul 08 16:33:53.422124 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.422097    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:33:53.431347 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431328    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431426    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431493    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w6jn\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431560    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo\") pod \"21bc633b-c980-4b77-a737-0b289f8d09ff\" (UID: \"21bc633b-c980-4b77-a737-0b289f8d09ff\") "
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431585    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:33:53.431675 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431642    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:33:53.431976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431839    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.431976 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431875    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.432074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431992    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:33:53.432074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.431995    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:33:53.432643 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.432616    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:33:53.433577 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.433555    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:33:53.433723 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.433703    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn" (OuterVolumeSpecName: "kube-api-access-8w6jn") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "kube-api-access-8w6jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:33:53.433922 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.433896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:33:53.434063 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.434047    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21bc633b-c980-4b77-a737-0b289f8d09ff" (UID: "21bc633b-c980-4b77-a737-0b289f8d09ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:33:53.532238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532210    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532235    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532244    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532253    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532260    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21bc633b-c980-4b77-a737-0b289f8d09ff-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532269    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21bc633b-c980-4b77-a737-0b289f8d09ff-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:53.532564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:53.532277    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w6jn\" (UniqueName: \"kubernetes.io/projected/21bc633b-c980-4b77-a737-0b289f8d09ff-kube-api-access-8w6jn\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:33:54.029389 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.029358    2562 generic.go:356] "Generic (PLEG): container finished" podID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerID="e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c" exitCode=0
Jul 08 16:33:54.029667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.029405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerDied","Data":"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"}
Jul 08 16:33:54.029667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.029443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz" event={"ID":"21bc633b-c980-4b77-a737-0b289f8d09ff","Type":"ContainerDied","Data":"649f79ac2b18ae077f2bd8c0ebb29c3a60114689a9f3afd4b9d7a943966fab01"}
Jul 08 16:33:54.029667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.029464    2562 scope.go:117] "RemoveContainer" containerID="e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"
Jul 08 16:33:54.029667 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.029406    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"
Jul 08 16:33:54.037897 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.037877    2562 scope.go:117] "RemoveContainer" containerID="5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"
Jul 08 16:33:54.045335 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.045317    2562 scope.go:117] "RemoveContainer" containerID="e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"
Jul 08 16:33:54.045564 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:33:54.045547    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c\": container with ID starting with e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c not found: ID does not exist" containerID="e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"
Jul 08 16:33:54.045607 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.045572    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c"} err="failed to get container status \"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c\": rpc error: code = NotFound desc = could not find container \"e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c\": container with ID starting with e005159015125434b15dd09f64419d0462f39148f67b614663ec4abd87bdae1c not found: ID does not exist"
Jul 08 16:33:54.045607 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.045588    2562 scope.go:117] "RemoveContainer" containerID="5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"
Jul 08 16:33:54.045813 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:33:54.045797    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866\": container with ID starting with 5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866 not found: ID does not exist" containerID="5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"
Jul 08 16:33:54.045879 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.045816    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866"} err="failed to get container status \"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866\": rpc error: code = NotFound desc = could not find container \"5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866\": container with ID starting with 5017900fef22de87f85b7bc72bf9f2e799694242f67cad1663e7c1d9020de866 not found: ID does not exist"
Jul 08 16:33:54.050461 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.050440    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:33:54.054458 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.054438    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f66b739c-openshift-default-5fcfcf474c-b4nbz"]
Jul 08 16:33:54.556791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:33:54.556761    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" path="/var/lib/kubelet/pods/21bc633b-c980-4b77-a737-0b289f8d09ff/volumes"
Jul 08 16:34:43.945055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945023    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945340    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" containerName="maas-api"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945351    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" containerName="maas-api"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945371    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945377    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945387    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945393    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945437    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945446    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21bc633b-c980-4b77-a737-0b289f8d09ff" containerName="istio-proxy"
Jul 08 16:34:43.945499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.945453    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9260b923-e6eb-4c8a-8526-049d11b5b3b3" containerName="maas-api"
Jul 08 16:34:43.948104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.948077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:43.950662 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.950641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ea60a0-openshift-default-dockercfg-2hqdj\""
Jul 08 16:34:43.963598 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:43.963571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:34:44.058334 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gxj\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058798 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.058798 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.058643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.159613 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.159764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.159764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.159924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.159924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160034 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160034 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.159981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160034 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160178 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160178 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gxj\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160178 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160146    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160337 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160337 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160329    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.160872 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.160832    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.162128 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.162109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.162228 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.162151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.170392 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.170370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gxj\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.170717 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.170700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token\") pod \"e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") " pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.257972 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.257901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:44.395350 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.395311    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:34:44.398235 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:34:44.398210    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc49fa77_7cc4_4e54_a04b_764b5c5ae214.slice/crio-d581d137054034bb22467754de2a26d7a5de36646fb7fef216707599cc67a158 WatchSource:0}: Error finding container d581d137054034bb22467754de2a26d7a5de36646fb7fef216707599cc67a158: Status 404 returned error can't find the container with id d581d137054034bb22467754de2a26d7a5de36646fb7fef216707599cc67a158
Jul 08 16:34:44.400316 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.400284    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:34:44.400412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.400359    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:34:44.400412 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:44.400389    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:34:45.248041 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:45.248000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerStarted","Data":"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"}
Jul 08 16:34:45.248528 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:45.248058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerStarted","Data":"d581d137054034bb22467754de2a26d7a5de36646fb7fef216707599cc67a158"}
Jul 08 16:34:45.258750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:45.258726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:45.263966 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:45.263945    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:45.276493 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:45.276443    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podStartSLOduration=2.276428931 podStartE2EDuration="2.276428931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:45.275139163 +0000 UTC m=+1853.412664133" watchObservedRunningTime="2026-07-08 16:34:45.276428931 +0000 UTC m=+1853.413953878"
Jul 08 16:34:46.252014 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:46.251979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:46.253082 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:46.253065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:34:47.529769 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.529733    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:34:47.533268 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.533252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.535997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.535975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ea60a0-serving-cert\""
Jul 08 16:34:47.536140 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.536123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:34:47.536828 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.536812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:34:47.537002 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.536983    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:34:47.546821 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.546797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:34:47.690550 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.690511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.690727 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.690558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp56w\" (UniqueName: \"kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.690727 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.690626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.791309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.791228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.791309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.791289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp56w\" (UniqueName: \"kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.791499 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.791349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.792137 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.792110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.793763 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.793745    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.801473 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.801452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp56w\" (UniqueName: \"kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w\") pod \"maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.844495 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.844453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:47.978286 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.978252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:34:47.980700 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:34:47.980672    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c239901_25cf_4655_ba9d_0068d9b8be0b.slice/crio-561ca7e2921fdb12d8a8ef786e42a7bc67d27fb57e55923421846a0e5ea530be WatchSource:0}: Error finding container 561ca7e2921fdb12d8a8ef786e42a7bc67d27fb57e55923421846a0e5ea530be: Status 404 returned error can't find the container with id 561ca7e2921fdb12d8a8ef786e42a7bc67d27fb57e55923421846a0e5ea530be
Jul 08 16:34:47.982090 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:47.982071    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:34:48.261128 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:48.261094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" event={"ID":"0c239901-25cf-4655-ba9d-0068d9b8be0b","Type":"ContainerStarted","Data":"561ca7e2921fdb12d8a8ef786e42a7bc67d27fb57e55923421846a0e5ea530be"}
Jul 08 16:34:49.266388 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:49.266354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" event={"ID":"0c239901-25cf-4655-ba9d-0068d9b8be0b","Type":"ContainerStarted","Data":"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"}
Jul 08 16:34:49.266788 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:49.266472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:49.291503 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:49.291451    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" podStartSLOduration=1.730139163 podStartE2EDuration="2.291433401s" totalImagesPullingTime="561.294238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:49.289999251 +0000 UTC m=+1857.427524198" watchObservedRunningTime="2026-07-08 16:34:49.291433401 +0000 UTC m=+1857.428958348"
Jul 08 16:34:55.275972 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.275939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:34:55.714809 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.713227    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:34:55.717000 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.716976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.719808 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.719605    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-dcd525-serving-cert\""
Jul 08 16:34:55.728164 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.727720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:34:55.757460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.757425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpwc5\" (UniqueName: \"kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.757619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.757474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.757619 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.757495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.858165 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.858136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.858378 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.858173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.858378 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.858232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwc5\" (UniqueName: \"kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.858378 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:34:55.858286    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-serving-cert: secret "maas-api-e2e-inf-b-dcd525-serving-cert" not found
Jul 08 16:34:55.858378 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:34:55.858363    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls podName:961a1755-ca4e-4f9c-b20c-e74a9bb97363 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:56.35834752 +0000 UTC m=+1864.495872445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls") pod "maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" (UID: "961a1755-ca4e-4f9c-b20c-e74a9bb97363") : secret "maas-api-e2e-inf-b-dcd525-serving-cert" not found
Jul 08 16:34:55.858830 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.858812    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:55.869668 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:55.869639    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwc5\" (UniqueName: \"kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:56.362049 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:56.362016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:56.364455 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:56.364437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") pod \"maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:56.635342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:56.635248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:56.799880 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:56.787295    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:34:56.815008 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:34:56.814977    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961a1755_ca4e_4f9c_b20c_e74a9bb97363.slice/crio-d70af95a30c549fbd111ce044abaa720489c6826d2af4a2f5ff473777012d043 WatchSource:0}: Error finding container d70af95a30c549fbd111ce044abaa720489c6826d2af4a2f5ff473777012d043: Status 404 returned error can't find the container with id d70af95a30c549fbd111ce044abaa720489c6826d2af4a2f5ff473777012d043
Jul 08 16:34:57.317570 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:57.317527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" event={"ID":"961a1755-ca4e-4f9c-b20c-e74a9bb97363","Type":"ContainerStarted","Data":"d70af95a30c549fbd111ce044abaa720489c6826d2af4a2f5ff473777012d043"}
Jul 08 16:34:58.322922 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:58.322882    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" event={"ID":"961a1755-ca4e-4f9c-b20c-e74a9bb97363","Type":"ContainerStarted","Data":"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"}
Jul 08 16:34:58.323379 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:58.323001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:34:58.340397 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:34:58.340340    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" podStartSLOduration=2.742035442 podStartE2EDuration="3.340324698s" totalImagesPullingTime="598.289256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:58.339056628 +0000 UTC m=+1866.476581600" watchObservedRunningTime="2026-07-08 16:34:58.340324698 +0000 UTC m=+1866.477849644"
Jul 08 16:35:02.294116 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:02.294062    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 16:35:02.294520 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:02.294150    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 16:35:03.345639 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.345608    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerID="00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591" exitCode=0
Jul 08 16:35:03.346191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.345671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerDied","Data":"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"}
Jul 08 16:35:03.346191 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.346142    2562 scope.go:117] "RemoveContainer" containerID="00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"
Jul 08 16:35:03.347125 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.347092    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:35:03.347219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.347181    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:35:03.347280 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:03.347230    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:35:04.332387 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:04.332352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:35:04.351397 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:04.351366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerStarted","Data":"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"}
Jul 08 16:35:05.258166 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:05.258124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:35:05.258389 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:05.258352    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 08 16:35:05.258469 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:05.258421    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 08 16:35:06.258781 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:06.258744    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 08 16:35:06.259201 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:06.258800    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 08 16:35:07.258493 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:07.258460    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 08 16:35:07.258659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:07.258527    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 08 16:35:08.262268 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:08.262231    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:35:08.262721 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:08.262524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:35:08.263252 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:35:08.263232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:36:23.908452 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:23.908389    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:36:23.909422 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:23.909381    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" podUID="0c239901-25cf-4655-ba9d-0068d9b8be0b" containerName="maas-api" containerID="cri-o://f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f" gracePeriod=30
Jul 08 16:36:24.154585 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.154557    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:36:24.250411 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.250317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca\") pod \"0c239901-25cf-4655-ba9d-0068d9b8be0b\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") "
Jul 08 16:36:24.250411 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.250367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp56w\" (UniqueName: \"kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w\") pod \"0c239901-25cf-4655-ba9d-0068d9b8be0b\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") "
Jul 08 16:36:24.250637 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.250441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls\") pod \"0c239901-25cf-4655-ba9d-0068d9b8be0b\" (UID: \"0c239901-25cf-4655-ba9d-0068d9b8be0b\") "
Jul 08 16:36:24.250734 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.250696    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c239901-25cf-4655-ba9d-0068d9b8be0b" (UID: "0c239901-25cf-4655-ba9d-0068d9b8be0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:36:24.252510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.252489    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c239901-25cf-4655-ba9d-0068d9b8be0b" (UID: "0c239901-25cf-4655-ba9d-0068d9b8be0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:36:24.252638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.252618    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w" (OuterVolumeSpecName: "kube-api-access-qp56w") pod "0c239901-25cf-4655-ba9d-0068d9b8be0b" (UID: "0c239901-25cf-4655-ba9d-0068d9b8be0b"). InnerVolumeSpecName "kube-api-access-qp56w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:36:24.351460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.351426    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c239901-25cf-4655-ba9d-0068d9b8be0b-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:36:24.351460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.351456    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c239901-25cf-4655-ba9d-0068d9b8be0b-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:36:24.351460 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.351465    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp56w\" (UniqueName: \"kubernetes.io/projected/0c239901-25cf-4655-ba9d-0068d9b8be0b-kube-api-access-qp56w\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:36:24.701430 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.701398    2562 generic.go:356] "Generic (PLEG): container finished" podID="0c239901-25cf-4655-ba9d-0068d9b8be0b" containerID="f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f" exitCode=0
Jul 08 16:36:24.701617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.701448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"
Jul 08 16:36:24.701617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.701492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" event={"ID":"0c239901-25cf-4655-ba9d-0068d9b8be0b","Type":"ContainerDied","Data":"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"}
Jul 08 16:36:24.701617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.701545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7" event={"ID":"0c239901-25cf-4655-ba9d-0068d9b8be0b","Type":"ContainerDied","Data":"561ca7e2921fdb12d8a8ef786e42a7bc67d27fb57e55923421846a0e5ea530be"}
Jul 08 16:36:24.701617 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.701567    2562 scope.go:117] "RemoveContainer" containerID="f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"
Jul 08 16:36:24.709692 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.709665    2562 scope.go:117] "RemoveContainer" containerID="f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"
Jul 08 16:36:24.709926 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:36:24.709906    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f\": container with ID starting with f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f not found: ID does not exist" containerID="f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"
Jul 08 16:36:24.709996 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.709934    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f"} err="failed to get container status \"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f\": rpc error: code = NotFound desc = could not find container \"f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f\": container with ID starting with f25f5b0f071f4731cc8b7e22d358ea221f7442f4127a969285d3be0a090a8f6f not found: ID does not exist"
Jul 08 16:36:24.718797 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.718774    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:36:24.723326 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:24.723305    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea60a0-6d7b69c9bc-v5ms7"]
Jul 08 16:36:26.557902 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:36:26.557845    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c239901-25cf-4655-ba9d-0068d9b8be0b" path="/var/lib/kubelet/pods/0c239901-25cf-4655-ba9d-0068d9b8be0b/volumes"
Jul 08 16:37:06.045956 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:06.045921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:37:06.046562 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:06.046156    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" containerID="cri-o://086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892" gracePeriod=30
Jul 08 16:37:07.341313 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:07.341278    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:37:07.341713 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:07.341514    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" podUID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" containerName="maas-api" containerID="cri-o://ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70" gracePeriod=30
Jul 08 16:37:08.264875 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.264818    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 16:37:08.265035 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.264907    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:37:08.582659 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.582636    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:37:08.627288 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.627253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca\") pod \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") "
Jul 08 16:37:08.627439 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.627300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpwc5\" (UniqueName: \"kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5\") pod \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") "
Jul 08 16:37:08.627439 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.627323    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") pod \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\" (UID: \"961a1755-ca4e-4f9c-b20c-e74a9bb97363\") "
Jul 08 16:37:08.627564 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.627539    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "961a1755-ca4e-4f9c-b20c-e74a9bb97363" (UID: "961a1755-ca4e-4f9c-b20c-e74a9bb97363"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:37:08.627689 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.627670    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/961a1755-ca4e-4f9c-b20c-e74a9bb97363-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:08.629368 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.629334    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "961a1755-ca4e-4f9c-b20c-e74a9bb97363" (UID: "961a1755-ca4e-4f9c-b20c-e74a9bb97363"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:37:08.629464 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.629388    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5" (OuterVolumeSpecName: "kube-api-access-mpwc5") pod "961a1755-ca4e-4f9c-b20c-e74a9bb97363" (UID: "961a1755-ca4e-4f9c-b20c-e74a9bb97363"). InnerVolumeSpecName "kube-api-access-mpwc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:08.728524 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.728488    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpwc5\" (UniqueName: \"kubernetes.io/projected/961a1755-ca4e-4f9c-b20c-e74a9bb97363-kube-api-access-mpwc5\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:08.728524 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.728519    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/961a1755-ca4e-4f9c-b20c-e74a9bb97363-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:08.891102 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.891022    2562 generic.go:356] "Generic (PLEG): container finished" podID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" containerID="ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70" exitCode=0
Jul 08 16:37:08.891102 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.891072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" event={"ID":"961a1755-ca4e-4f9c-b20c-e74a9bb97363","Type":"ContainerDied","Data":"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"}
Jul 08 16:37:08.891102 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.891076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"
Jul 08 16:37:08.891309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.891113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h" event={"ID":"961a1755-ca4e-4f9c-b20c-e74a9bb97363","Type":"ContainerDied","Data":"d70af95a30c549fbd111ce044abaa720489c6826d2af4a2f5ff473777012d043"}
Jul 08 16:37:08.891309 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.891134    2562 scope.go:117] "RemoveContainer" containerID="ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"
Jul 08 16:37:08.899921 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.899905    2562 scope.go:117] "RemoveContainer" containerID="ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"
Jul 08 16:37:08.900168 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:08.900150    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70\": container with ID starting with ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70 not found: ID does not exist" containerID="ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"
Jul 08 16:37:08.900213 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.900176    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70"} err="failed to get container status \"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70\": rpc error: code = NotFound desc = could not find container \"ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70\": container with ID starting with ddea1d1821af215db73d8f9926acc2602893d63e89c4cfa141070caea7629d70 not found: ID does not exist"
Jul 08 16:37:08.912793 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.912772    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:37:08.917102 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:08.917081    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-dcd525-5679f7b45b-7ln7h"]
Jul 08 16:37:10.552450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:10.552417    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" path="/var/lib/kubelet/pods/961a1755-ca4e-4f9c-b20c-e74a9bb97363/volumes"
Jul 08 16:37:11.295786 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.295762    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:37:11.352773 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6gxj\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.352773 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352793    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352882    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.352983    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353245 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo\") pod \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\" (UID: \"bc49fa77-7cc4-4e54-a04b-764b5c5ae214\") "
Jul 08 16:37:11.353245 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353164    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:11.353370 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353348    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.353520 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353464    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:11.353591 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353539    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:11.353763 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353726    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:11.353850 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.353760    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:37:11.355121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.355095    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:11.355121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.355107    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj" (OuterVolumeSpecName: "kube-api-access-v6gxj") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "kube-api-access-v6gxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:11.355503 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.355483    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:37:11.355503 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.355480    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc49fa77-7cc4-4e54-a04b-764b5c5ae214" (UID: "bc49fa77-7cc4-4e54-a04b-764b5c5ae214"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:11.453733 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453700    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6gxj\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-kube-api-access-v6gxj\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.453733 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453727    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.453733 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453737    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.453733 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453745    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.454020 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.454020 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453760    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.454020 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453768    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.454020 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.453776    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc49fa77-7cc4-4e54-a04b-764b5c5ae214-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:11.907104 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.907069    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerID="086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892" exitCode=0
Jul 08 16:37:11.907548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.907147    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"
Jul 08 16:37:11.907548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.907153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerDied","Data":"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"}
Jul 08 16:37:11.907548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.907235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j" event={"ID":"bc49fa77-7cc4-4e54-a04b-764b5c5ae214","Type":"ContainerDied","Data":"d581d137054034bb22467754de2a26d7a5de36646fb7fef216707599cc67a158"}
Jul 08 16:37:11.907548 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.907259    2562 scope.go:117] "RemoveContainer" containerID="086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"
Jul 08 16:37:11.916960 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.916936    2562 scope.go:117] "RemoveContainer" containerID="00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"
Jul 08 16:37:11.924556 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.924539    2562 scope.go:117] "RemoveContainer" containerID="086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"
Jul 08 16:37:11.924794 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:11.924778    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892\": container with ID starting with 086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892 not found: ID does not exist" containerID="086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"
Jul 08 16:37:11.924842 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.924803    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892"} err="failed to get container status \"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892\": rpc error: code = NotFound desc = could not find container \"086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892\": container with ID starting with 086c351ac358caca408ed3e169445e4f8c3ee91c0a78d55a78bffd994ed81892 not found: ID does not exist"
Jul 08 16:37:11.924842 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.924819    2562 scope.go:117] "RemoveContainer" containerID="00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"
Jul 08 16:37:11.925111 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:11.925093    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591\": container with ID starting with 00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591 not found: ID does not exist" containerID="00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"
Jul 08 16:37:11.925175 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.925120    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591"} err="failed to get container status \"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591\": rpc error: code = NotFound desc = could not find container \"00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591\": container with ID starting with 00190f9dc43087047cfe8e33f58f27136fe0fa7238e9087d3b2cd017637c5591 not found: ID does not exist"
Jul 08 16:37:11.934384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.934361    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:37:11.937974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:11.937953    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ea60a0-openshift-default-79d7d9b755-cbk2j"]
Jul 08 16:37:12.553259 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:12.553227    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" path="/var/lib/kubelet/pods/bc49fa77-7cc4-4e54-a04b-764b5c5ae214/volumes"
Jul 08 16:37:14.315097 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315065    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315375    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315387    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315406    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315411    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315417    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c239901-25cf-4655-ba9d-0068d9b8be0b" containerName="maas-api"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315422    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c239901-25cf-4655-ba9d-0068d9b8be0b" containerName="maas-api"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315428    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" containerName="maas-api"
Jul 08 16:37:14.315463 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315433    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" containerName="maas-api"
Jul 08 16:37:14.315705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315476    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315483    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c239901-25cf-4655-ba9d-0068d9b8be0b" containerName="maas-api"
Jul 08 16:37:14.315705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315489    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc49fa77-7cc4-4e54-a04b-764b5c5ae214" containerName="istio-proxy"
Jul 08 16:37:14.315705 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.315497    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="961a1755-ca4e-4f9c-b20c-e74a9bb97363" containerName="maas-api"
Jul 08 16:37:14.319798 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.319778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.322836 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.322810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-400b4d-openshift-default-dockercfg-8dxpf\""
Jul 08 16:37:14.331109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.331087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:14.377215 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377404 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377610 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mkf\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.377610 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.377480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mkf\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.478967 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.478885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.479297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.479117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.479297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.479171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.479297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.479252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.479401 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.479308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.479521 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.479501    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.481061 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.481043    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.481365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.481347    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.487134 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.487110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.487290 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.487270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mkf\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf\") pod \"e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") " pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.629879 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.629778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:14.767160 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.767137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:14.769447 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:37:14.769412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9361e73d_573a_4da5_aca7_17b5a5c22e5e.slice/crio-3bddbd0f84e2918bafdd52b5b2b49ea485df4ef39a47312a72eb161da17bf8ea WatchSource:0}: Error finding container 3bddbd0f84e2918bafdd52b5b2b49ea485df4ef39a47312a72eb161da17bf8ea: Status 404 returned error can't find the container with id 3bddbd0f84e2918bafdd52b5b2b49ea485df4ef39a47312a72eb161da17bf8ea
Jul 08 16:37:14.771485 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.771456    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:14.771545 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.771517    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:14.771583 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.771548    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:14.923235 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.923144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerStarted","Data":"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"}
Jul 08 16:37:14.923235 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.923202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerStarted","Data":"3bddbd0f84e2918bafdd52b5b2b49ea485df4ef39a47312a72eb161da17bf8ea"}
Jul 08 16:37:14.944561 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:14.944505    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podStartSLOduration=0.944489161 podStartE2EDuration="944.489161ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:14.942955205 +0000 UTC m=+2003.080480153" watchObservedRunningTime="2026-07-08 16:37:14.944489161 +0000 UTC m=+2003.082014108"
Jul 08 16:37:15.630974 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:15.630933    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:15.635924 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:15.635901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:15.927235 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:15.927153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:15.928065 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:15.928047    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:16.971985 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.971951    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:16.975213 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.975194    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:16.978194 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.978169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:37:16.978194 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.978185    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-400b4d-serving-cert\""
Jul 08 16:37:16.978995 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.978978    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:37:16.978995 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.978986    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:37:16.985578 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:16.985556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:17.000709 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.000682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82v7p\" (UniqueName: \"kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.000830 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.000731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.000830 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.000750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.102161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.102125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.102161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.102161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.102368 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.102227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82v7p\" (UniqueName: \"kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.102368 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:17.102278    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-serving-cert: secret "maas-api-e2e-api-a-400b4d-serving-cert" not found
Jul 08 16:37:17.102368 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:17.102348    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls podName:ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd nodeName:}" failed. No retries permitted until 2026-07-08 16:37:17.602329343 +0000 UTC m=+2005.739854268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls") pod "maas-api-e2e-api-a-400b4d-668b8bc445-rz478" (UID: "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd") : secret "maas-api-e2e-api-a-400b4d-serving-cert" not found
Jul 08 16:37:17.102909 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.102892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.137364 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.137333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82v7p\" (UniqueName: \"kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.607182 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.607144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.609558 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.609532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") pod \"maas-api-e2e-api-a-400b4d-668b8bc445-rz478\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:17.886651 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:17.886549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:18.023204 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:18.023179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:18.024790 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:37:18.024768    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4f1380_1b68_4c36_b7b3_0543fd1c1ffd.slice/crio-c36c29caa4e86e141ae077be7b92f0d0bc5b0211ba5c740cd3cbbf30da7e3b4a WatchSource:0}: Error finding container c36c29caa4e86e141ae077be7b92f0d0bc5b0211ba5c740cd3cbbf30da7e3b4a: Status 404 returned error can't find the container with id c36c29caa4e86e141ae077be7b92f0d0bc5b0211ba5c740cd3cbbf30da7e3b4a
Jul 08 16:37:18.939987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:18.939949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" event={"ID":"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd","Type":"ContainerStarted","Data":"a93fac336e91b9bd14797837a5c9c42d8120fe7a638b59704a2e5b7e13f93508"}
Jul 08 16:37:18.940181 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:18.940013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" event={"ID":"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd","Type":"ContainerStarted","Data":"c36c29caa4e86e141ae077be7b92f0d0bc5b0211ba5c740cd3cbbf30da7e3b4a"}
Jul 08 16:37:18.940181 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:18.940044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:18.958249 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:18.958151    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" podStartSLOduration=2.286476754 podStartE2EDuration="2.958133473s" totalImagesPullingTime="671.656719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:18.957008636 +0000 UTC m=+2007.094533596" watchObservedRunningTime="2026-07-08 16:37:18.958133473 +0000 UTC m=+2007.095658421"
Jul 08 16:37:24.950520 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:24.950489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:25.479302 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.479269    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:25.482613 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.482589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.486896 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.486874    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-63af7a-serving-cert\""
Jul 08 16:37:25.494238 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.494216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:25.572604 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.572573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.572764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.572617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.572764 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.572674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4582\" (UniqueName: \"kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.673297 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.673265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.673491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.673328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.673491 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.673361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4582\" (UniqueName: \"kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.673995 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.673976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.675582 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.675561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.689033 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.689005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4582\" (UniqueName: \"kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582\") pod \"maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.794421 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.794333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:25.926433 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.926409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:25.929175 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:37:25.929137    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e81b38_3b27_4142_8171_80eabc779641.slice/crio-4586171394b4145bf30c5ba6771f6efccf3eb647f4e8a34c0ae3581b211ce410 WatchSource:0}: Error finding container 4586171394b4145bf30c5ba6771f6efccf3eb647f4e8a34c0ae3581b211ce410: Status 404 returned error can't find the container with id 4586171394b4145bf30c5ba6771f6efccf3eb647f4e8a34c0ae3581b211ce410
Jul 08 16:37:25.970935 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:25.970903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" event={"ID":"c4e81b38-3b27-4142-8171-80eabc779641","Type":"ContainerStarted","Data":"4586171394b4145bf30c5ba6771f6efccf3eb647f4e8a34c0ae3581b211ce410"}
Jul 08 16:37:26.976636 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:26.976602    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" event={"ID":"c4e81b38-3b27-4142-8171-80eabc779641","Type":"ContainerStarted","Data":"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"}
Jul 08 16:37:26.977011 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:26.976674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:27.006365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:27.006297    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" podStartSLOduration=1.097415071 podStartE2EDuration="2.006274665s" totalImagesPullingTime="908.859594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:27.003070405 +0000 UTC m=+2015.140595377" watchObservedRunningTime="2026-07-08 16:37:27.006274665 +0000 UTC m=+2015.143799612"
Jul 08 16:37:31.969055 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:31.969011    2562 patch_prober.go:28] interesting pod/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 16:37:31.969514 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:31.969114    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 16:37:32.987172 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:32.987137    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:34.013497 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.013463    2562 generic.go:356] "Generic (PLEG): container finished" podID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerID="5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd" exitCode=0
Jul 08 16:37:34.013987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.013505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerDied","Data":"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"}
Jul 08 16:37:34.013987 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.013881    2562 scope.go:117] "RemoveContainer" containerID="5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"
Jul 08 16:37:34.014964 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.014928    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:34.015059 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.015002    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:34.015059 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:34.015035    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:35.020147 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:35.020110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerStarted","Data":"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"}
Jul 08 16:37:35.630494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:35.630447    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:35.630739 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:35.630714    2562 patch_prober.go:28] interesting pod/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 08 16:37:35.630790 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:35.630768    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 08 16:37:36.630689 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:36.630653    2562 patch_prober.go:28] interesting pod/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 08 16:37:36.631151 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:36.630739    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 08 16:37:37.630376 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:37.630337    2562 patch_prober.go:28] interesting pod/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 08 16:37:37.630638 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:37.630393    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 08 16:37:38.630961 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:38.630917    2562 patch_prober.go:28] interesting pod/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 08 16:37:38.631359 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:38.630979    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 08 16:37:38.916251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:38.916170    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:38.916400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:38.916380    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" podUID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" containerName="maas-api" containerID="cri-o://a93fac336e91b9bd14797837a5c9c42d8120fe7a638b59704a2e5b7e13f93508" gracePeriod=30
Jul 08 16:37:39.038635 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.038596    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" containerID="a93fac336e91b9bd14797837a5c9c42d8120fe7a638b59704a2e5b7e13f93508" exitCode=0
Jul 08 16:37:39.038773 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.038667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" event={"ID":"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd","Type":"ContainerDied","Data":"a93fac336e91b9bd14797837a5c9c42d8120fe7a638b59704a2e5b7e13f93508"}
Jul 08 16:37:39.160074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.160046    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:39.310176 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.310075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca\") pod \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") "
Jul 08 16:37:39.310176 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.310122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82v7p\" (UniqueName: \"kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p\") pod \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") "
Jul 08 16:37:39.310419 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.310238    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") pod \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\" (UID: \"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd\") "
Jul 08 16:37:39.310551 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.310522    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" (UID: "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:37:39.312324 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.312292    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" (UID: "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:37:39.312442 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.312343    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p" (OuterVolumeSpecName: "kube-api-access-82v7p") pod "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" (UID: "ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd"). InnerVolumeSpecName "kube-api-access-82v7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:39.411278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.411237    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:39.411278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.411271    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82v7p\" (UniqueName: \"kubernetes.io/projected/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-kube-api-access-82v7p\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:39.411278 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.411281    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:39.635807 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.635776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:39.636212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.636166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:39.636756 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:39.636736    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:40.049977 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.049874    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"
Jul 08 16:37:40.049977 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.049886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478" event={"ID":"ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd","Type":"ContainerDied","Data":"c36c29caa4e86e141ae077be7b92f0d0bc5b0211ba5c740cd3cbbf30da7e3b4a"}
Jul 08 16:37:40.049977 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.049976    2562 scope.go:117] "RemoveContainer" containerID="a93fac336e91b9bd14797837a5c9c42d8120fe7a638b59704a2e5b7e13f93508"
Jul 08 16:37:40.071725 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.071701    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:40.075314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.075290    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-400b4d-668b8bc445-rz478"]
Jul 08 16:37:40.553015 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:40.552984    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" path="/var/lib/kubelet/pods/ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd/volumes"
Jul 08 16:37:45.116375 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:45.116340    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:45.116818 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:45.116577    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy" containerID="cri-o://52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89" gracePeriod=30
Jul 08 16:37:46.341713 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.341678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:46.342248 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.341970    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" podUID="c4e81b38-3b27-4142-8171-80eabc779641" containerName="maas-api" containerID="cri-o://3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909" gracePeriod=30
Jul 08 16:37:46.594064 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.594004    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:46.681402 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.681375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4582\" (UniqueName: \"kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582\") pod \"c4e81b38-3b27-4142-8171-80eabc779641\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") "
Jul 08 16:37:46.681402 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.681409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca\") pod \"c4e81b38-3b27-4142-8171-80eabc779641\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") "
Jul 08 16:37:46.681623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.681480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls\") pod \"c4e81b38-3b27-4142-8171-80eabc779641\" (UID: \"c4e81b38-3b27-4142-8171-80eabc779641\") "
Jul 08 16:37:46.681812 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.681788    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4e81b38-3b27-4142-8171-80eabc779641" (UID: "c4e81b38-3b27-4142-8171-80eabc779641"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:37:46.683535 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.683501    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582" (OuterVolumeSpecName: "kube-api-access-q4582") pod "c4e81b38-3b27-4142-8171-80eabc779641" (UID: "c4e81b38-3b27-4142-8171-80eabc779641"). InnerVolumeSpecName "kube-api-access-q4582". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:46.683645 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.683581    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4e81b38-3b27-4142-8171-80eabc779641" (UID: "c4e81b38-3b27-4142-8171-80eabc779641"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:37:46.782070 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.782036    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4e81b38-3b27-4142-8171-80eabc779641-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:46.782070 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.782064    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4582\" (UniqueName: \"kubernetes.io/projected/c4e81b38-3b27-4142-8171-80eabc779641-kube-api-access-q4582\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:46.782070 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:46.782075    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e81b38-3b27-4142-8171-80eabc779641-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:47.081797 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.081764    2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e81b38-3b27-4142-8171-80eabc779641" containerID="3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909" exitCode=0
Jul 08 16:37:47.081997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.081807    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"
Jul 08 16:37:47.081997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.081848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" event={"ID":"c4e81b38-3b27-4142-8171-80eabc779641","Type":"ContainerDied","Data":"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"}
Jul 08 16:37:47.081997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.081914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps" event={"ID":"c4e81b38-3b27-4142-8171-80eabc779641","Type":"ContainerDied","Data":"4586171394b4145bf30c5ba6771f6efccf3eb647f4e8a34c0ae3581b211ce410"}
Jul 08 16:37:47.081997 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.081939    2562 scope.go:117] "RemoveContainer" containerID="3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"
Jul 08 16:37:47.093109 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.093084    2562 scope.go:117] "RemoveContainer" containerID="3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"
Jul 08 16:37:47.093721 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:47.093699    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909\": container with ID starting with 3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909 not found: ID does not exist" containerID="3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"
Jul 08 16:37:47.093809 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.093728    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909"} err="failed to get container status \"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909\": rpc error: code = NotFound desc = could not find container \"3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909\": container with ID starting with 3d07bcf6acdffebb1a49afd36293579177f97326323472269c5272822e35e909 not found: ID does not exist"
Jul 08 16:37:47.111267 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.111241    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:47.117662 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:47.117639    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63af7a-7564fd5c46-c88ps"]
Jul 08 16:37:48.552414 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:48.552380    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e81b38-3b27-4142-8171-80eabc779641" path="/var/lib/kubelet/pods/c4e81b38-3b27-4142-8171-80eabc779641/volumes"
Jul 08 16:37:50.369590 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.369562    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:50.408510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408454    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408510 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408513    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408551    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408600    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408633    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.408787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44mkf\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf\") pod \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\" (UID: \"9361e73d-573a-4da5-aca7-17b5a5c22e5e\") "
Jul 08 16:37:50.409118 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.408787    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:50.409118 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.409057    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.409318 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.409294    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:50.409385 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.409325    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:50.409504 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.409482    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:37:50.409712 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.409692    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:50.410765 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.410742    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:37:50.411150 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.411128    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:37:50.411304 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.411169    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:50.411375 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.411329    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf" (OuterVolumeSpecName: "kube-api-access-44mkf") pod "9361e73d-573a-4da5-aca7-17b5a5c22e5e" (UID: "9361e73d-573a-4da5-aca7-17b5a5c22e5e"). InnerVolumeSpecName "kube-api-access-44mkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:37:50.510161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510130    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510158    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510161 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510168    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44mkf\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-kube-api-access-44mkf\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510177    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510186    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510194    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510202    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:50.510410 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:50.510211    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9361e73d-573a-4da5-aca7-17b5a5c22e5e-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:37:51.102587 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.102555    2562 generic.go:356] "Generic (PLEG): container finished" podID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerID="52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89" exitCode=0
Jul 08 16:37:51.102743 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.102603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"
Jul 08 16:37:51.102743 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.102647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerDied","Data":"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"}
Jul 08 16:37:51.102743 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.102702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88" event={"ID":"9361e73d-573a-4da5-aca7-17b5a5c22e5e","Type":"ContainerDied","Data":"3bddbd0f84e2918bafdd52b5b2b49ea485df4ef39a47312a72eb161da17bf8ea"}
Jul 08 16:37:51.102743 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.102724    2562 scope.go:117] "RemoveContainer" containerID="52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"
Jul 08 16:37:51.111006 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.110985    2562 scope.go:117] "RemoveContainer" containerID="5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"
Jul 08 16:37:51.129691 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.129657    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:51.131047 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.131021    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-400b4d-openshift-default-7cbdc7bf55-sgv88"]
Jul 08 16:37:51.132651 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.132632    2562 scope.go:117] "RemoveContainer" containerID="52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"
Jul 08 16:37:51.133040 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:51.133020    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89\": container with ID starting with 52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89 not found: ID does not exist" containerID="52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"
Jul 08 16:37:51.133098 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.133050    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89"} err="failed to get container status \"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89\": rpc error: code = NotFound desc = could not find container \"52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89\": container with ID starting with 52775ee26f9dd4b195ea8429c06c2090b60082f1405d6465ed9039ab0defcf89 not found: ID does not exist"
Jul 08 16:37:51.133098 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.133070    2562 scope.go:117] "RemoveContainer" containerID="5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"
Jul 08 16:37:51.133316 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:51.133302    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd\": container with ID starting with 5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd not found: ID does not exist" containerID="5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"
Jul 08 16:37:51.133361 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:51.133319    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd"} err="failed to get container status \"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd\": rpc error: code = NotFound desc = could not find container \"5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd\": container with ID starting with 5f53906f72e3e029c2460febf6f04216cd7a22e0dd49ef13eb0556b05615eafd not found: ID does not exist"
Jul 08 16:37:52.553899 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:52.553840    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" path="/var/lib/kubelet/pods/9361e73d-573a-4da5-aca7-17b5a5c22e5e/volumes"
Jul 08 16:37:53.281911 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.281878    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:37:53.282186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282175    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e81b38-3b27-4142-8171-80eabc779641" containerName="maas-api"
Jul 08 16:37:53.282237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282189    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e81b38-3b27-4142-8171-80eabc779641" containerName="maas-api"
Jul 08 16:37:53.282237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282199    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" containerName="maas-api"
Jul 08 16:37:53.282237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282204    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" containerName="maas-api"
Jul 08 16:37:53.282237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282214    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282219    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282253    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282259    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282305    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e81b38-3b27-4142-8171-80eabc779641" containerName="maas-api"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282314    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282319    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9361e73d-573a-4da5-aca7-17b5a5c22e5e" containerName="istio-proxy"
Jul 08 16:37:53.282384 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.282324    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4f1380-1b68-4c36-b7b3-0543fd1c1ffd" containerName="maas-api"
Jul 08 16:37:53.285131 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.285114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.287370 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.287347    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0c5df2-openshift-default-dockercfg-w8w6x\""
Jul 08 16:37:53.297077 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.297054    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:37:53.337894 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.337894 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.337987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.338027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.338066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.338351 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.338160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpkh\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439496 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpkh\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439496 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439724 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439724 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439724 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439923 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439923 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439923 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.439923 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.440130 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.439951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.440130 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.440037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.440236 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.440153    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.440236 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.440202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.440525 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.440480    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.442537 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.442503    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.442655 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.442605    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.447867 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.447831    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.448149 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.448125    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpkh\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh\") pod \"e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") " pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.595474 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.595380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:53.737623 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.737581    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:37:53.739762 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:37:53.739734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a89edd_71af_4f0a_bc9c_a14cfedb4b41.slice/crio-2f45c527f95ced77f8b7b0413e2cd4921aab8b07ff12c53d03683eb94695012f WatchSource:0}: Error finding container 2f45c527f95ced77f8b7b0413e2cd4921aab8b07ff12c53d03683eb94695012f: Status 404 returned error can't find the container with id 2f45c527f95ced77f8b7b0413e2cd4921aab8b07ff12c53d03683eb94695012f
Jul 08 16:37:53.741800 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.741770    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:53.741889 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.741830    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:53.741933 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:53.741889    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:37:54.117216 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:54.117180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerStarted","Data":"cff43ee8fcb2ab0acddb22d42db7e0ca82fd0e6094ea5a59787aef07cbb3c51e"}
Jul 08 16:37:54.117418 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:54.117242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerStarted","Data":"2f45c527f95ced77f8b7b0413e2cd4921aab8b07ff12c53d03683eb94695012f"}
Jul 08 16:37:54.139056 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:54.139008    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podStartSLOduration=1.138991203 podStartE2EDuration="1.138991203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:54.13784867 +0000 UTC m=+2042.275373627" watchObservedRunningTime="2026-07-08 16:37:54.138991203 +0000 UTC m=+2042.276516151"
Jul 08 16:37:54.595629 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:54.595602    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:54.600494 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:54.600470    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:55.121901 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:55.121871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:55.122783 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:55.122764    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:37:56.136985 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.136950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:37:56.140465 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.140441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.143219 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.143195    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0c5df2-serving-cert\""
Jul 08 16:37:56.143340 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.143204    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:37:56.144110 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.144093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\""
Jul 08 16:37:56.144201 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.144166    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:37:56.153250 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.153230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:37:56.166690 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.166662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.166827 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.166718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmds\" (UniqueName: \"kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.167177 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.167154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.268360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.268327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.268360 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.268366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmds\" (UniqueName: \"kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.268628 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.268433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.268628 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:56.268480    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-serving-cert: secret "maas-api-e2e-shared-a-0c5df2-serving-cert" not found
Jul 08 16:37:56.268628 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:56.268547    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls podName:55427fc3-eb65-465e-a2d3-55c36bffa777 nodeName:}" failed. No retries permitted until 2026-07-08 16:37:56.768529447 +0000 UTC m=+2044.906054371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls") pod "maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" (UID: "55427fc3-eb65-465e-a2d3-55c36bffa777") : secret "maas-api-e2e-shared-a-0c5df2-serving-cert" not found
Jul 08 16:37:56.269090 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.269072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.277368 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.277347    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmds\" (UniqueName: \"kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.773695 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:56.773640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:56.773915 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:56.773874    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-serving-cert: secret "maas-api-e2e-shared-a-0c5df2-serving-cert" not found
Jul 08 16:37:56.773989 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:37:56.773954    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls podName:55427fc3-eb65-465e-a2d3-55c36bffa777 nodeName:}" failed. No retries permitted until 2026-07-08 16:37:57.7739304 +0000 UTC m=+2045.911455328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls") pod "maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" (UID: "55427fc3-eb65-465e-a2d3-55c36bffa777") : secret "maas-api-e2e-shared-a-0c5df2-serving-cert" not found
Jul 08 16:37:57.784450 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:57.784401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:57.786784 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:57.786756    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:57.950635 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:57.950609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:58.086799 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:58.086764    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:37:58.089470 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:37:58.089435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55427fc3_eb65_465e_a2d3_55c36bffa777.slice/crio-5a9d6fa00715d0fc92718fc180319e8ebd576895ff33e4764ca34d1d4d674605 WatchSource:0}: Error finding container 5a9d6fa00715d0fc92718fc180319e8ebd576895ff33e4764ca34d1d4d674605: Status 404 returned error can't find the container with id 5a9d6fa00715d0fc92718fc180319e8ebd576895ff33e4764ca34d1d4d674605
Jul 08 16:37:58.137608 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:58.137583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" event={"ID":"55427fc3-eb65-465e-a2d3-55c36bffa777","Type":"ContainerStarted","Data":"5a9d6fa00715d0fc92718fc180319e8ebd576895ff33e4764ca34d1d4d674605"}
Jul 08 16:37:59.143978 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:59.143944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" event={"ID":"55427fc3-eb65-465e-a2d3-55c36bffa777","Type":"ContainerStarted","Data":"d7c4de332689f9758dae538a0cc9ce0f7e7a9b76dfbe67383b2f780af5e920f2"}
Jul 08 16:37:59.144354 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:59.144080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:37:59.162988 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:37:59.162936    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" podStartSLOduration=2.784217606 podStartE2EDuration="3.162920071s" totalImagesPullingTime="378.702465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:59.162130485 +0000 UTC m=+2047.299655432" watchObservedRunningTime="2026-07-08 16:37:59.162920071 +0000 UTC m=+2047.300445026"
Jul 08 16:38:04.762724 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.762683    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:38:04.766131 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.766109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.769707 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.769682    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5494d3-serving-cert\""
Jul 08 16:38:04.802026 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.801981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:38:04.847652 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.847619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbhnk\" (UniqueName: \"kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.847884 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.847677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.847884 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.847755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.949257 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.949217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.949449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.949314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbhnk\" (UniqueName: \"kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.949449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.949393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.949586 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:38:04.949447    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-serving-cert: secret "maas-api-e2e-shared-b-5494d3-serving-cert" not found
Jul 08 16:38:04.949586 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:38:04.949541    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls podName:f21ca1cc-443c-48f7-925e-028d76e2d2bc nodeName:}" failed. No retries permitted until 2026-07-08 16:38:05.449519448 +0000 UTC m=+2053.587044373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls") pod "maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" (UID: "f21ca1cc-443c-48f7-925e-028d76e2d2bc") : secret "maas-api-e2e-shared-b-5494d3-serving-cert" not found
Jul 08 16:38:04.950084 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.950064    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:04.972107 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:04.972082    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbhnk\" (UniqueName: \"kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:05.154007 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:05.153981    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:38:05.455519 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:05.455417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:05.457805 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:05.457784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:05.677121 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:05.677090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:05.860489 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:05.860410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:38:05.863183 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:38:05.863146    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21ca1cc_443c_48f7_925e_028d76e2d2bc.slice/crio-57bdb919ef63e21bf0e11066f63f8cd2577f3263d7e6d1cd4a771d8ff13fa609 WatchSource:0}: Error finding container 57bdb919ef63e21bf0e11066f63f8cd2577f3263d7e6d1cd4a771d8ff13fa609: Status 404 returned error can't find the container with id 57bdb919ef63e21bf0e11066f63f8cd2577f3263d7e6d1cd4a771d8ff13fa609
Jul 08 16:38:06.174736 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:06.174698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" event={"ID":"f21ca1cc-443c-48f7-925e-028d76e2d2bc","Type":"ContainerStarted","Data":"57bdb919ef63e21bf0e11066f63f8cd2577f3263d7e6d1cd4a771d8ff13fa609"}
Jul 08 16:38:07.180013 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:07.179981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" event={"ID":"f21ca1cc-443c-48f7-925e-028d76e2d2bc","Type":"ContainerStarted","Data":"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"}
Jul 08 16:38:07.180466 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:07.180117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:11.138222 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.137322    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 16:38:11.138222 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.137402    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 16:38:11.199374 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.199339    2562 generic.go:356] "Generic (PLEG): container finished" podID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerID="cff43ee8fcb2ab0acddb22d42db7e0ca82fd0e6094ea5a59787aef07cbb3c51e" exitCode=0
Jul 08 16:38:11.199546 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.199410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerDied","Data":"cff43ee8fcb2ab0acddb22d42db7e0ca82fd0e6094ea5a59787aef07cbb3c51e"}
Jul 08 16:38:11.199874 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.199843    2562 scope.go:117] "RemoveContainer" containerID="cff43ee8fcb2ab0acddb22d42db7e0ca82fd0e6094ea5a59787aef07cbb3c51e"
Jul 08 16:38:11.200868 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.200830    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:38:11.200947 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.200923    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:38:11.200992 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.200970    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 16:38:11.222791 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:11.222742    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" podStartSLOduration=6.717169422 podStartE2EDuration="7.222729312s" totalImagesPullingTime="505.55989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:38:07.202874267 +0000 UTC m=+2055.340399206" watchObservedRunningTime="2026-07-08 16:38:11.222729312 +0000 UTC m=+2059.360254259"
Jul 08 16:38:12.205531 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:12.205498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerStarted","Data":"df4e0a1d987ac6b276e5b604b879484e60595e7a75f48707aec7f29c5ed6a7a2"}
Jul 08 16:38:12.596175 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:12.596135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:38:12.596449 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:12.596420    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 08 16:38:12.596544 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:12.596497    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 08 16:38:13.200339 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:13.200243    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:38:13.596776 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:13.596734    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 08 16:38:13.597400 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:13.597365    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 08 16:38:14.596632 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:14.596589    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 08 16:38:14.596846 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:14.596661    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 08 16:38:15.596521 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:15.596479    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 08 16:38:15.596750 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:15.596546    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 08 16:38:16.599553 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:16.599528    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:38:16.599953 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:16.599883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:38:16.600642 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:38:16.600623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:41:14.811698 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:14.811618    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:41:14.812268 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:14.811835    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" podUID="55427fc3-eb65-465e-a2d3-55c36bffa777" containerName="maas-api" containerID="cri-o://d7c4de332689f9758dae538a0cc9ce0f7e7a9b76dfbe67383b2f780af5e920f2" gracePeriod=30
Jul 08 16:41:14.991720 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:14.991676    2562 generic.go:356] "Generic (PLEG): container finished" podID="55427fc3-eb65-465e-a2d3-55c36bffa777" containerID="d7c4de332689f9758dae538a0cc9ce0f7e7a9b76dfbe67383b2f780af5e920f2" exitCode=0
Jul 08 16:41:14.991979 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:14.991749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" event={"ID":"55427fc3-eb65-465e-a2d3-55c36bffa777","Type":"ContainerDied","Data":"d7c4de332689f9758dae538a0cc9ce0f7e7a9b76dfbe67383b2f780af5e920f2"}
Jul 08 16:41:15.053506 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.053483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:41:15.089999 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.089975    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gmds\" (UniqueName: \"kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds\") pod \"55427fc3-eb65-465e-a2d3-55c36bffa777\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") "
Jul 08 16:41:15.090179 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.090010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca\") pod \"55427fc3-eb65-465e-a2d3-55c36bffa777\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") "
Jul 08 16:41:15.090179 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.090073    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") pod \"55427fc3-eb65-465e-a2d3-55c36bffa777\" (UID: \"55427fc3-eb65-465e-a2d3-55c36bffa777\") "
Jul 08 16:41:15.090388 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.090362    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55427fc3-eb65-465e-a2d3-55c36bffa777" (UID: "55427fc3-eb65-465e-a2d3-55c36bffa777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:41:15.092212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.092190    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds" (OuterVolumeSpecName: "kube-api-access-5gmds") pod "55427fc3-eb65-465e-a2d3-55c36bffa777" (UID: "55427fc3-eb65-465e-a2d3-55c36bffa777"). InnerVolumeSpecName "kube-api-access-5gmds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:41:15.092274 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.092217    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55427fc3-eb65-465e-a2d3-55c36bffa777" (UID: "55427fc3-eb65-465e-a2d3-55c36bffa777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:41:15.191342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.191317    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gmds\" (UniqueName: \"kubernetes.io/projected/55427fc3-eb65-465e-a2d3-55c36bffa777-kube-api-access-5gmds\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:15.191342 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.191342    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55427fc3-eb65-465e-a2d3-55c36bffa777-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:15.191530 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.191351    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55427fc3-eb65-465e-a2d3-55c36bffa777-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:15.997636 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.997607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75" event={"ID":"55427fc3-eb65-465e-a2d3-55c36bffa777","Type":"ContainerDied","Data":"5a9d6fa00715d0fc92718fc180319e8ebd576895ff33e4764ca34d1d4d674605"}
Jul 08 16:41:15.997636 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.997629    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"
Jul 08 16:41:15.998190 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:15.997674    2562 scope.go:117] "RemoveContainer" containerID="d7c4de332689f9758dae538a0cc9ce0f7e7a9b76dfbe67383b2f780af5e920f2"
Jul 08 16:41:16.017186 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:16.017151    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:41:16.018660 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:16.018638    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c5df2-5c4cb979d-ldw75"]
Jul 08 16:41:16.552285 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:16.552256    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55427fc3-eb65-465e-a2d3-55c36bffa777" path="/var/lib/kubelet/pods/55427fc3-eb65-465e-a2d3-55c36bffa777/volumes"
Jul 08 16:41:20.888765 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:20.888734    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:41:20.889328 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:20.889004    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy" containerID="cri-o://df4e0a1d987ac6b276e5b604b879484e60595e7a75f48707aec7f29c5ed6a7a2" gracePeriod=30
Jul 08 16:41:21.947917 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:21.947881    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:41:21.948388 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:21.948133    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" podUID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" containerName="maas-api" containerID="cri-o://b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c" gracePeriod=30
Jul 08 16:41:22.186010 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.185981    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:41:22.256752 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.256668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbhnk\" (UniqueName: \"kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk\") pod \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") "
Jul 08 16:41:22.256752 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.256717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") pod \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") "
Jul 08 16:41:22.257014 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.256767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca\") pod \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\" (UID: \"f21ca1cc-443c-48f7-925e-028d76e2d2bc\") "
Jul 08 16:41:22.257212 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.257186    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f21ca1cc-443c-48f7-925e-028d76e2d2bc" (UID: "f21ca1cc-443c-48f7-925e-028d76e2d2bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:41:22.258717 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.258686    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f21ca1cc-443c-48f7-925e-028d76e2d2bc" (UID: "f21ca1cc-443c-48f7-925e-028d76e2d2bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:41:22.258820 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.258744    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk" (OuterVolumeSpecName: "kube-api-access-tbhnk") pod "f21ca1cc-443c-48f7-925e-028d76e2d2bc" (UID: "f21ca1cc-443c-48f7-925e-028d76e2d2bc"). InnerVolumeSpecName "kube-api-access-tbhnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:41:22.357671 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.357618    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbhnk\" (UniqueName: \"kubernetes.io/projected/f21ca1cc-443c-48f7-925e-028d76e2d2bc-kube-api-access-tbhnk\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:22.357671 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.357666    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21ca1cc-443c-48f7-925e-028d76e2d2bc-maas-api-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:22.357671 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:22.357679    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ca1cc-443c-48f7-925e-028d76e2d2bc-openshift-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:23.031876 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.031825    2562 generic.go:356] "Generic (PLEG): container finished" podID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" containerID="b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c" exitCode=0
Jul 08 16:41:23.031876 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.031878    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"
Jul 08 16:41:23.032359 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.031912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" event={"ID":"f21ca1cc-443c-48f7-925e-028d76e2d2bc","Type":"ContainerDied","Data":"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"}
Jul 08 16:41:23.032359 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.031968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p" event={"ID":"f21ca1cc-443c-48f7-925e-028d76e2d2bc","Type":"ContainerDied","Data":"57bdb919ef63e21bf0e11066f63f8cd2577f3263d7e6d1cd4a771d8ff13fa609"}
Jul 08 16:41:23.032359 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.031995    2562 scope.go:117] "RemoveContainer" containerID="b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"
Jul 08 16:41:23.041810 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.041793    2562 scope.go:117] "RemoveContainer" containerID="b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"
Jul 08 16:41:23.042137 ip-10-0-138-121 kubenswrapper[2562]: E0708 16:41:23.042115    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c\": container with ID starting with b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c not found: ID does not exist" containerID="b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"
Jul 08 16:41:23.042210 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.042149    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c"} err="failed to get container status \"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c\": rpc error: code = NotFound desc = could not find container \"b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c\": container with ID starting with b89b5452d70ca2276ede25dc919ec029b1ef5fb86cbf4734b88693bf0afcde6c not found: ID does not exist"
Jul 08 16:41:23.052774 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.052748    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:41:23.056993 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:23.056972    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5494d3-76f7989c5b-vgm8p"]
Jul 08 16:41:24.552787 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:24.552751    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" path="/var/lib/kubelet/pods/f21ca1cc-443c-48f7-925e-028d76e2d2bc/volumes"
Jul 08 16:41:26.048433 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.048399    2562 generic.go:356] "Generic (PLEG): container finished" podID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerID="df4e0a1d987ac6b276e5b604b879484e60595e7a75f48707aec7f29c5ed6a7a2" exitCode=0
Jul 08 16:41:26.048814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.048478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerDied","Data":"df4e0a1d987ac6b276e5b604b879484e60595e7a75f48707aec7f29c5ed6a7a2"}
Jul 08 16:41:26.048814 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.048546    2562 scope.go:117] "RemoveContainer" containerID="cff43ee8fcb2ab0acddb22d42db7e0ca82fd0e6094ea5a59787aef07cbb3c51e"
Jul 08 16:41:26.139509 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.139485    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:41:26.188998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.188914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.188998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.188948    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.188998 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.188982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189006    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwpkh\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189071    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189111    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo\") pod \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\" (UID: \"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41\") "
Jul 08 16:41:26.189289 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189257    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:41:26.189640 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189450    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.189640 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189436    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:41:26.189640 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189495    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:41:26.189799 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189640    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:41:26.189878 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.189836    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:41:26.191300 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.191276    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:41:26.191435 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.191269    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:41:26.191435 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.191322    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:41:26.191435 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.191346    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh" (OuterVolumeSpecName: "kube-api-access-hwpkh") pod "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" (UID: "a2a89edd-71af-4f0a-bc9c-a14cfedb4b41"). InnerVolumeSpecName "kube-api-access-hwpkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:41:26.290098 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290066    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290098 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290090    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290098 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290101    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290110    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290118    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwpkh\" (UniqueName: \"kubernetes.io/projected/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-kube-api-access-hwpkh\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290129    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290137    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:26.290314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:26.290145    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 08 16:41:27.054178 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:27.054146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk" event={"ID":"a2a89edd-71af-4f0a-bc9c-a14cfedb4b41","Type":"ContainerDied","Data":"2f45c527f95ced77f8b7b0413e2cd4921aab8b07ff12c53d03683eb94695012f"}
Jul 08 16:41:27.054178 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:27.054172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"
Jul 08 16:41:27.054650 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:27.054203    2562 scope.go:117] "RemoveContainer" containerID="df4e0a1d987ac6b276e5b604b879484e60595e7a75f48707aec7f29c5ed6a7a2"
Jul 08 16:41:27.072532 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:27.072503    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:41:27.076918 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:27.076894    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5df2-openshift-default-74b997979-hwsnk"]
Jul 08 16:41:28.552989 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:28.552946    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" path="/var/lib/kubelet/pods/a2a89edd-71af-4f0a-bc9c-a14cfedb4b41/volumes"
Jul 08 16:41:34.031344 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:34.031300    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9pw9x_39a7ad31-5b79-43ae-a45a-61e00355f387/manager/0.log"
Jul 08 16:41:34.148014 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:34.147988    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-77bmf_01002223-7974-455d-8452-a7da026fcc97/manager/0.log"
Jul 08 16:41:34.155474 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:34.155451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-77bmf_01002223-7974-455d-8452-a7da026fcc97/copy-manifests/0.log"
Jul 08 16:41:37.184745 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:37.184715    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l6c5d_5f4d0ebc-4dcd-498e-bcae-11afc23063aa/discovery/0.log"
Jul 08 16:41:37.299287 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:37.299258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-hfnwn_c025ace5-5264-44fd-bf58-402f8f226d21/kube-auth-proxy/0.log"
Jul 08 16:41:46.156024 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:46.155990    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6vd4z_7f6baffc-9360-4166-a8db-0a950ae9232c/global-pull-secret-syncer/0.log"
Jul 08 16:41:46.333468 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:46.333434    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tjjsm_b54a212a-94bb-46dd-b266-3d30d666e02b/konnectivity-agent/0.log"
Jul 08 16:41:46.411894 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:46.411803    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-121.ec2.internal_4f681de8e64470bdc7eb29251e740caf/haproxy/0.log"
Jul 08 16:41:54.213346 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.213310    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6797f4b689-9mlwp_78ce094b-a178-4bac-a157-4c3f79b1a8ab/metrics-server/0.log"
Jul 08 16:41:54.238915 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.238889    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rzdjj_5d505aad-d6f0-4f8d-9cc6-f47a7394a191/monitoring-plugin/0.log"
Jul 08 16:41:54.450824 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.450741    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqtvt_f1513385-b268-4393-8284-b29b2769b30c/node-exporter/0.log"
Jul 08 16:41:54.482294 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.482264    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqtvt_f1513385-b268-4393-8284-b29b2769b30c/kube-rbac-proxy/0.log"
Jul 08 16:41:54.506327 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.506308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqtvt_f1513385-b268-4393-8284-b29b2769b30c/init-textfile/0.log"
Jul 08 16:41:54.614797 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.614767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/prometheus/0.log"
Jul 08 16:41:54.637346 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.637315    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/config-reloader/0.log"
Jul 08 16:41:54.672586 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.672562    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/thanos-sidecar/0.log"
Jul 08 16:41:54.707605 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.707546    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/kube-rbac-proxy-web/0.log"
Jul 08 16:41:54.730190 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.730169    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/kube-rbac-proxy/0.log"
Jul 08 16:41:54.751908 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.751889    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/kube-rbac-proxy-thanos/0.log"
Jul 08 16:41:54.773428 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.773413    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32d08e7d-c260-417e-83c6-f6ea32403732/init-config-reloader/0.log"
Jul 08 16:41:54.964557 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.964480    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/thanos-query/0.log"
Jul 08 16:41:54.986498 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:54.986477    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/kube-rbac-proxy-web/0.log"
Jul 08 16:41:55.009692 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:55.009668    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/kube-rbac-proxy/0.log"
Jul 08 16:41:55.033321 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:55.033297    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/prom-label-proxy/0.log"
Jul 08 16:41:55.060314 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:55.060293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/kube-rbac-proxy-rules/0.log"
Jul 08 16:41:55.083016 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:55.082997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884c575cc-fpd5x_2665d38c-7c7b-4798-8e63-233149f7d4d6/kube-rbac-proxy-metrics/0.log"
Jul 08 16:41:56.608039 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608003    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"]
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608420    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy"
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608438    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy"
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608454    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" containerName="maas-api"
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608471    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" containerName="maas-api"
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608505    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55427fc3-eb65-465e-a2d3-55c36bffa777" containerName="maas-api"
Jul 08 16:41:56.608533 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608513    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="55427fc3-eb65-465e-a2d3-55c36bffa777" containerName="maas-api"
Jul 08 16:41:56.608840 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608589    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f21ca1cc-443c-48f7-925e-028d76e2d2bc" containerName="maas-api"
Jul 08 16:41:56.608840 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608604    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a89edd-71af-4f0a-bc9c-a14cfedb4b41" containerName="istio-proxy"
Jul 08 16:41:56.608840 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.608617    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="55427fc3-eb65-465e-a2d3-55c36bffa777" containerName="maas-api"
Jul 08 16:41:56.611553 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.611529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.613954 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.613930    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qvbgl\"/\"default-dockercfg-2sphb\""
Jul 08 16:41:56.614094 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.614002    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvbgl\"/\"openshift-service-ca.crt\""
Jul 08 16:41:56.614208 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.614192    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvbgl\"/\"kube-root-ca.crt\""
Jul 08 16:41:56.624296 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.624276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"]
Jul 08 16:41:56.747687 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.747650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-sys\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.747687 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.747687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-proc\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.748039 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.747710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-podres\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.748039 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.747838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tf9q\" (UniqueName: \"kubernetes.io/projected/e81974a4-a0b6-4579-b27f-3e086e67031b-kube-api-access-7tf9q\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.748039 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.747915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-lib-modules\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848345 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tf9q\" (UniqueName: \"kubernetes.io/projected/e81974a4-a0b6-4579-b27f-3e086e67031b-kube-api-access-7tf9q\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848531 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848354    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-lib-modules\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848531 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848511    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-lib-modules\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848649 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-sys\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848649 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-proc\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848649 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-podres\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848649 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848627    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-proc\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848649 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848634    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-sys\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.848837 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.848735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e81974a4-a0b6-4579-b27f-3e086e67031b-podres\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.856530 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.856513    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tf9q\" (UniqueName: \"kubernetes.io/projected/e81974a4-a0b6-4579-b27f-3e086e67031b-kube-api-access-7tf9q\") pod \"perf-node-gather-daemonset-xxnwz\" (UID: \"e81974a4-a0b6-4579-b27f-3e086e67031b\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:56.921662 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:56.921570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:57.057061 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:57.057032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"]
Jul 08 16:41:57.059637 ip-10-0-138-121 kubenswrapper[2562]: W0708 16:41:57.059611    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode81974a4_a0b6_4579_b27f_3e086e67031b.slice/crio-87e21759c169407719a173b265bf12b2795989d587357a0680aaa80f694ae9a1 WatchSource:0}: Error finding container 87e21759c169407719a173b265bf12b2795989d587357a0680aaa80f694ae9a1: Status 404 returned error can't find the container with id 87e21759c169407719a173b265bf12b2795989d587357a0680aaa80f694ae9a1
Jul 08 16:41:57.182721 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:57.182639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz" event={"ID":"e81974a4-a0b6-4579-b27f-3e086e67031b","Type":"ContainerStarted","Data":"87e21759c169407719a173b265bf12b2795989d587357a0680aaa80f694ae9a1"}
Jul 08 16:41:58.188848 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:58.188812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz" event={"ID":"e81974a4-a0b6-4579-b27f-3e086e67031b","Type":"ContainerStarted","Data":"01e7382bee15cb92b4abe8601df2708dca8bab7a3301fcffecb901d5fa49cebe"}
Jul 08 16:41:58.189251 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:58.188926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:41:58.207111 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:58.207064    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz" podStartSLOduration=2.207049172 podStartE2EDuration="2.207049172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:58.204991442 +0000 UTC m=+2286.342516382" watchObservedRunningTime="2026-07-08 16:41:58.207049172 +0000 UTC m=+2286.344574119"
Jul 08 16:41:59.179252 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:59.179223    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d9fzj_172e81bc-141e-4a35-87b6-eada05ce22f6/dns/0.log"
Jul 08 16:41:59.203365 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:59.203337    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d9fzj_172e81bc-141e-4a35-87b6-eada05ce22f6/kube-rbac-proxy/0.log"
Jul 08 16:41:59.322117 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:59.322086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2qt6c_08f6e348-bfff-4722-919a-5b4788b3144a/dns-node-resolver/0.log"
Jul 08 16:41:59.886621 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:59.886594    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b85d48547-4x26z_ef7c15e8-c666-452b-8f0c-82b5526ae29a/registry/0.log"
Jul 08 16:41:59.931207 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:41:59.931182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75qvs_40625286-0103-447c-b7b6-ab0c69cdd403/node-ca/0.log"
Jul 08 16:42:00.999908 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:00.999871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l6c5d_5f4d0ebc-4dcd-498e-bcae-11afc23063aa/discovery/0.log"
Jul 08 16:42:01.022326 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:01.022294    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-hfnwn_c025ace5-5264-44fd-bf58-402f8f226d21/kube-auth-proxy/0.log"
Jul 08 16:42:02.008270 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:02.008236    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttkdg_78e18bc5-1b45-4e83-9171-db32d0f611b6/serve-healthcheck-canary/0.log"
Jul 08 16:42:02.539616 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:02.539590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cswwj_bc05f5d0-4ff9-4669-9ba4-9eac689c9170/kube-rbac-proxy/0.log"
Jul 08 16:42:02.560888 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:02.560833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cswwj_bc05f5d0-4ff9-4669-9ba4-9eac689c9170/exporter/0.log"
Jul 08 16:42:02.588599 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:02.588574    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cswwj_bc05f5d0-4ff9-4669-9ba4-9eac689c9170/extractor/0.log"
Jul 08 16:42:04.202277 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:04.202250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-xxnwz"
Jul 08 16:42:05.402653 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:05.402620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9pw9x_39a7ad31-5b79-43ae-a45a-61e00355f387/manager/0.log"
Jul 08 16:42:05.431447 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:05.431421    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-77bmf_01002223-7974-455d-8452-a7da026fcc97/manager/0.log"
Jul 08 16:42:05.456123 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:05.456094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-77bmf_01002223-7974-455d-8452-a7da026fcc97/copy-manifests/0.log"
Jul 08 16:42:07.075539 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:07.075505    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bf555d8d4-5fgxb_c1dd1ac1-bc20-437e-adce-b8bd4c680a94/manager/0.log"
Jul 08 16:42:07.111534 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:07.111500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-44xvl_d1544a76-dd4b-4bef-bc5a-459fd56bfbda/openshift-lws-operator/0.log"
Jul 08 16:42:07.153440 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:07.153410    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l6c5d_5f4d0ebc-4dcd-498e-bcae-11afc23063aa/discovery/0.log"
Jul 08 16:42:07.170074 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:07.170047    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-hfnwn_c025ace5-5264-44fd-bf58-402f8f226d21/kube-auth-proxy/0.log"
Jul 08 16:42:08.697370 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:08.697339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l6c5d_5f4d0ebc-4dcd-498e-bcae-11afc23063aa/discovery/0.log"
Jul 08 16:42:08.714189 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:08.714163    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-hfnwn_c025ace5-5264-44fd-bf58-402f8f226d21/kube-auth-proxy/0.log"
Jul 08 16:42:13.841046 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:13.841016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6bwlz_30ed6908-e51f-4cbf-b415-afad588c7048/kube-multus/0.log"
Jul 08 16:42:13.912586 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:13.912556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/kube-multus-additional-cni-plugins/0.log"
Jul 08 16:42:13.937753 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:13.937724    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/egress-router-binary-copy/0.log"
Jul 08 16:42:13.959995 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:13.959971    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/cni-plugins/0.log"
Jul 08 16:42:13.984023 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:13.984003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/bond-cni-plugin/0.log"
Jul 08 16:42:14.010231 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:14.010205    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/routeoverride-cni/0.log"
Jul 08 16:42:14.033217 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:14.033192    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/whereabouts-cni-bincopy/0.log"
Jul 08 16:42:14.058237 ip-10-0-138-121 kubenswrapper[2562]: I0708 16:42:14.058212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp649_b2ca60ca-f568-41ab-b851-077892cc4a2d/whereabouts-cni/0.log"