Jul 17 21:15:00.798129 ip-10-0-128-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 21:15:00.798143 ip-10-0-128-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 21:15:00.798153 ip-10-0-128-177 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 21:15:00.798518 ip-10-0-128-177 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 21:15:11.026456 ip-10-0-128-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 21:15:11.026476 ip-10-0-128-177 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2a0b1ca21cb2418b9c2724d0b02d99fc --
Jul 17 21:17:13.107105 ip-10-0-128-177 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 21:17:13.473878 ip-10-0-128-177 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:17:13.473878 ip-10-0-128-177 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 21:17:13.473878 ip-10-0-128-177 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:17:13.473878 ip-10-0-128-177 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 21:17:13.473878 ip-10-0-128-177 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:17:13.476204 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.476109    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 21:17:13.480423 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480407    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.480423 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480423    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480428    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480431    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480434    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480437    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480440    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480443    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480446    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480449    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480451    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480455    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480457    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480461    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480464    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480467    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480470    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480472    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480475    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480477    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480480    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.480485 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480488    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480491    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480494    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480497    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480499    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480502    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480505    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480507    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480509    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480512    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480514    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480516    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480519    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480521    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480524    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480526    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480528    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480531    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480533    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480535    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.480953 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480538    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480541    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480543    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480546    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480548    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480551    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480553    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480556    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480558    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480561    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480565    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480569    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480571    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480574    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480580    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480584    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480587    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480590    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480593    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.481472 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480596    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480598    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480601    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480603    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480606    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480608    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480611    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480613    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480616    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480618    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480621    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480623    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480626    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480628    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480630    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480633    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480635    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480638    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480641    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480644    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480646    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.481963 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480648    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480651    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480653    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480656    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480658    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480660    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480664    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480667    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480669    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480673    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480676    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480679    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480682    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480684    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480687    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480689    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480692    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.480694    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481433    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481440    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.482493 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481443    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481445    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481450    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481454    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481457    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481460    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481462    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481464    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481467    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481470    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481473    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481476    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481479    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481482    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481484    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481487    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481489    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481492    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481494    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.482988 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481497    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481500    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481503    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481505    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481508    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481510    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481512    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481515    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481517    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481520    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481522    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481524    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481527    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481529    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481531    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481534    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481537    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481539    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481542    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481544    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.483680 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481546    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481549    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481552    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481556    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481558    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481561    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481563    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481566    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481569    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481571    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481574    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481576    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481579    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481583    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481587    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481590    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481592    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481595    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481598    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481601    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.484418 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481604    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481606    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481609    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481611    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481614    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481616    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481619    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481622    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481626    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481630    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481633    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481635    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481638    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481641    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481644    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481647    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481650    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481653    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481655    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481658    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.484924 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481661    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481663    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481666    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481668    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481670    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481673    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481676    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481678    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481680    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481683    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481685    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481688    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481690    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481693    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481695    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481697    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481700    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.481702    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482146    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482152    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.485448 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482155    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482158    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482161    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482164    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482166    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482169    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482172    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482175    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482178    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482182    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482185    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482188    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482190    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482193    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482195    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482198    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482200    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482203    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482206    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.485946 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482208    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482211    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482213    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482215    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482218    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482220    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482223    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482225    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482228    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482230    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482233    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482235    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482238    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482242    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482245    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482248    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482251    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482254    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482258    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.486408 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482261    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482264    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482267    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482269    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482272    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482274    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482277    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482279    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482281    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482284    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482286    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482289    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482291    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482294    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482296    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482299    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482301    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482303    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482306    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482308    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.486889 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482312    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482314    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482316    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482319    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482321    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482324    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482327    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482329    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482332    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482334    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482336    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482339    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482341    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482344    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482346    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482349    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482352    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482354    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482356    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482359    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.487348 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482362    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482364    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482367    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482369    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482372    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482374    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482377    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482379    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482382    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482385    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482387    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482389    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482392    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482394    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482397    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482399    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482402    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482404    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.482407    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482482    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482488    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 21:17:13.487827 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482495    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482500    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482504    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482508    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482512    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482517    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482520    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482523    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482526    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482530    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482532    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482535    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482538    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482541    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482544    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482546    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482550    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482552    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482556    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482559    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482563    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482567    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482569    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 21:17:13.488310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482572    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482575    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482578    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482581    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482584    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482586    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482589    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482593    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482596    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482598    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482601    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482604    2579 flags.go:64] FLAG: --enable-server="true"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482610    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482619    2579 flags.go:64] FLAG: --event-burst="100"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482622    2579 flags.go:64] FLAG: --event-qps="50"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482625    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482628    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482631    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482635    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482637    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482640    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482643    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482646    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482649    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482651    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 21:17:13.488875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482654    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482657    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482660    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482663    2579 flags.go:64] FLAG: --feature-gates=""
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482667    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482670    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482673    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482676    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482678    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482681    2579 flags.go:64] FLAG: --help="false"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482684    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482687    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482692    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482696    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482701    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482705    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482707    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482710    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482713    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482717    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482720    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482723    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482725    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482728    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 21:17:13.489534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482731    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482734    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482736    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482739    2579 flags.go:64] FLAG: --lock-file=""
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482742    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482744    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482747    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482753    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482755    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482758    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482777    2579 flags.go:64] FLAG: --logging-format="text"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482784    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482790    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482794    2579 flags.go:64] FLAG: --manifest-url=""
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482797    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482802    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482805    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482809    2579 flags.go:64] FLAG: --max-pods="110"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482812    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482815    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482818    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482821    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482824    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482826    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482829    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 21:17:13.490138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482836    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482839    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482843    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482846    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482849    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482855    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482857    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482860    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482863    2579 flags.go:64] FLAG: --port="10250"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482866    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482868    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e6d2db522f45c80"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482872    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482874    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482878    2579 flags.go:64] FLAG: --register-node="true"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482880    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482884    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482887    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482890    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482894    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482898    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482901    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482904    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482907    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482910    2579 flags.go:64] FLAG: --runonce="false"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482912    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 21:17:13.490882 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482915    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482918    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482921    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482924    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482926    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482929    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482932    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482935    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482937    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482940    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482944    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482947    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482950    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482952    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482957    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482960    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482962    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482966    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482969    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482971    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482974    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482977    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482980    2579 flags.go:64] FLAG: --v="2"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482984    2579 flags.go:64] FLAG: --version="false"
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482988    2579 flags.go:64] FLAG: --vmodule=""
Jul 17 21:17:13.491906 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482993    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.482996    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484524    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484539    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484543    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484545    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484549    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484552    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484554    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484557    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484559    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484562    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484564    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484567    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484569    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484572    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484574    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484577    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484579    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484581    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.492943 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484584    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484586    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484596    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484601    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484604    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484607    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484610    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484612    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484615    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484617    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484620    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484622    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484625    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484627    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484631    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484636    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484638    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484641    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484645    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.493852 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484647    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484650    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484652    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484655    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484657    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484660    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484662    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484665    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484667    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484670    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484672    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484675    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484677    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484680    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484682    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484685    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484688    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484691    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484693    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.494655 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484697    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484700    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484703    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484707    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484711    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484714    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484717    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484720    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484723    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484727    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484729    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484732    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484735    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484737    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484740    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484742    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484745    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484747    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484750    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.495403 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484752    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484755    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484757    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484760    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484779    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484782    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484785    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484787    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484791    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484793    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484797    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484799    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484802    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484804    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484807    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484809    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484812    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484814    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484819    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484821    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.496188 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484824    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484826    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484831    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.484833    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.485437    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.492955    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.492979    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.493007    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.493022    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493120    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493128    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493133    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493137    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493142    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493146    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.496894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493152    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493156    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493160    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493164    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493168    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493172    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493176    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493180    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493185    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493189    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493193    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493197    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493200    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493205    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493209    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493213    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493217    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493221    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493226    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.497435 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493230    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493234    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493238    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493243    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493249    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493254    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493258    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493262    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493266    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493270    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493275    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493278    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493282    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493286    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493290    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493294    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493298    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493302    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493306    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493310    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.497959 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493314    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493319    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493323    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493327    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493330    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493343    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493347    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493351    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493357    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493363    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493367    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493389    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493394    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493398    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493402    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493408    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493414    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493420    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493425    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.498475 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493430    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493434    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493439    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493443    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493448    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493452    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493457    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493461    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493466    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493470    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493474    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493479    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493483    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493487    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493491    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493495    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493499    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493503    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493507    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493514    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.499013 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493520    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493525    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493529    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493533    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493537    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493541    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493545    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493550    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493554    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493559    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493563    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493568    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493572    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493576    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493580    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.499581 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.493588    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493819    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493828    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493833    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493838    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493842    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493846    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493851    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493854    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493858    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493864    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493870    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493874    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493879    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493883    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493888    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493892    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493896    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493900    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:17:13.499981 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493904    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493908    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493913    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493917    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493921    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493925    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493929    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493935    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493941    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493945    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493950    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493955    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493959    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493963    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493967    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493973    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493978    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493983    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493988    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:17:13.500443 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493992    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.493996    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494001    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494005    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494009    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494013    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494017    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494021    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494026    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494030    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494034    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494038    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494041    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494046    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494049    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494053    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494058    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494062    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494067    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494072    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:17:13.501161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494076    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494081    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494085    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494089    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494095    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494099    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494103    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494108    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494112    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494116    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494120    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494124    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494128    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494132    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494137    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494141    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494145    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494149    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494153    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494157    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:17:13.501979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494161    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494165    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494169    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494173    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494177    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494182    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494186    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494190    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494195    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494199    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494203    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494207    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494211    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494216    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494219    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494224    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494228    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494233    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494238    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494242    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:17:13.502844 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494246    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.494250    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.494258    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.494465    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.497170    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.498564    2579 server.go:1019] "Starting client certificate rotation"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.498667    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.498741    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.501284    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:17:13.503639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.503474    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:17:13.518293 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.518267    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 17 21:17:13.521909 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.521886    2579 log.go:25] "Validated CRI v1 image API"
Jul 17 21:17:13.523012 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.522993    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 21:17:13.525190 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.525166    2579 fs.go:135] Filesystem UUIDs: map[05abd8b6-91b1-4f9a-b93b-db2b65406ba5:/dev/nvme0n1p4 28619aa1-4600-4443-9106-b4dad18355a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 17 21:17:13.525246 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.525184    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 21:17:13.530169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.530141    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:17:13.531893 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.531779    2579 manager.go:216] Machine: {Timestamp:2026-07-17 21:17:13.530659008 +0000 UTC m=+0.311918726 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3153936 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2424e2a372e59cda33660e36d64259 SystemUUID:ec2424e2-a372-e59c-da33-660e36d64259 BootID:2a0b1ca2-1cb2-418b-9c27-24d0b02d99fc Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:50:31:5f:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:50:31:5f:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:95:1f:e8:60:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 21:17:13.531893 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.531892    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 21:17:13.531992 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.531979    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 21:17:13.534892 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.534845    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 21:17:13.535038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.534895    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 21:17:13.535501 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.535492    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 21:17:13.535537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.535503    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 21:17:13.535537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.535510    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:17:13.536137 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.536126    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:17:13.537828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.537817    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 21:17:13.541236 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541223    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:17:13.541352 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541343    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 21:17:13.541407 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541393    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 21:17:13.541407 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541403    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 21:17:13.541462 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541417    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 21:17:13.541462 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541428    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 17 21:17:13.541462 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541437    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 21:17:13.541778 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541748    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:17:13.541826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.541781    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:17:13.544196 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.544178    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 21:17:13.546360 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.546345    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 21:17:13.546431 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.546377    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 21:17:13.548013 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548000    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548017    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548024    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548034    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548045    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548051    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548061    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548066    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548079    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 21:17:13.548096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548087    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 21:17:13.548476 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548115    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 21:17:13.548476 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548122    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 21:17:13.548890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548878    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 21:17:13.548890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.548891    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 21:17:13.551745 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.551723    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 21:17:13.551845 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.551745    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 21:17:13.551845 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.551753    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 21:17:13.552420 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.552406    2579 server.go:1268] "Started kubelet"
Jul 17 21:17:13.552491 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.552462    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 21:17:13.552632 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.552600    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 21:17:13.552693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.552677    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 21:17:13.553481 ip-10-0-128-177 systemd[1]: Started Kubernetes Kubelet.
Jul 17 21:17:13.554254 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.554225    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-px7w2"
Jul 17 21:17:13.555064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.555041    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 21:17:13.557409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.557391    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 21:17:13.557498 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.556556    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-177.ec2.internal.18c33058636fce76  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-177.ec2.internal,UID:ip-10-0-128-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-177.ec2.internal,},FirstTimestamp:2026-07-17 21:17:13.552375414 +0000 UTC m=+0.333635132,LastTimestamp:2026-07-17 21:17:13.552375414 +0000 UTC m=+0.333635132,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-177.ec2.internal,}"
Jul 17 21:17:13.558285 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.558260    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 21:17:13.560233 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.560219    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-px7w2"
Jul 17 21:17:13.565717 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.565693    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 21:17:13.565865 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.565843    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.565971 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.565954    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 21:17:13.566464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.566421    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 21:17:13.566464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.566439    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 21:17:13.566583 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.566569    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 21:17:13.566657 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.566643    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 21:17:13.566657 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.566655    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 21:17:13.567457 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567429    2579 factory.go:55] Registering systemd factory
Jul 17 21:17:13.567457 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567450    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 17 21:17:13.567715 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567702    2579 factory.go:153] Registering CRI-O factory
Jul 17 21:17:13.567791 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567717    2579 factory.go:223] Registration of the crio container factory successfully
Jul 17 21:17:13.567838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567807    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 21:17:13.567838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567832    2579 factory.go:103] Registering Raw factory
Jul 17 21:17:13.567923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.567847    2579 manager.go:1196] Started watching for new ooms in manager
Jul 17 21:17:13.568658 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.568628    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 21:17:13.568759 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.568647    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 21:17:13.568890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.568870    2579 manager.go:349] Starting recovery of all containers
Jul 17 21:17:13.578387 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:13.578086    2579 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/pids.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/pids.max: no such device
Jul 17 21:17:13.581445 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.581426    2579 manager.go:354] Recovery completed
Jul 17 21:17:13.586170 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.586155    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.593302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.593280    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.593445 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.593319    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.593445 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.593338    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.594015 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.593989    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 21:17:13.594015 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594003    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 21:17:13.594128 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594021    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.594128 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594023    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:17:13.594753 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594738    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.594826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594817    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.594872 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.594835    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.595303 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.595291    2579 policy_none.go:49] "None policy: Start"
Jul 17 21:17:13.595350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.595308    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 21:17:13.595350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.595319    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 21:17:13.596348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.596339    2579 policy_none.go:47] "Start"
Jul 17 21:17:13.640560 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.640536    2579 manager.go:337] "Starting Device Plugin manager"
Jul 17 21:17:13.640699 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.640603    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 21:17:13.640699 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.640613    2579 server.go:87] "Starting device plugin registration server"
Jul 17 21:17:13.640944 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.640931    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 21:17:13.640988 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.640967    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 21:17:13.641116 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.641097    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 21:17:13.641354 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.641244    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 21:17:13.641354 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.641260    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 21:17:13.641993 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.641960    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 21:17:13.642081 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.642018    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.741450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.741336    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.742580 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.742406    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.742580 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.742443    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.742580 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.742457    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.742580 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.742510    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.748573 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.748554    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.748632 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.748581    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-177.ec2.internal\": node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.754672 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.754641    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 21:17:13.755970 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.755956    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 21:17:13.756052 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.755986    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 21:17:13.756052 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.756008    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 21:17:13.756160 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.756047    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 21:17:13.758056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.758032    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:13.760304 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.760285    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.856686 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.856623    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"]
Jul 17 21:17:13.856859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.856736    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.858415 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.858390    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.858552 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.858436    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.858552 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.858467    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.859891 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.859877    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.860008 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.859993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.860048 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860026    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.860499 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.860482    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.860854 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860831    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.860973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860865    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.860973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860836    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.860973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860878    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.860973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860895    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.860973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.860909    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.862299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.862281    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.862359 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.862327    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:17:13.863148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.863133    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:17:13.863148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.863157    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:17:13.863291 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.863182    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:17:13.868530 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.868512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.868605 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.868538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.868605 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.868557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/940dc9292c7a092fd2444fd3c4d9e071-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"940dc9292c7a092fd2444fd3c4d9e071\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.890630 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.890603    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.895039 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.895023    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.961068 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:13.961034    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:13.969651 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.969743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.969743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/940dc9292c7a092fd2444fd3c4d9e071-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"940dc9292c7a092fd2444fd3c4d9e071\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.969743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969720    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/940dc9292c7a092fd2444fd3c4d9e071-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"940dc9292c7a092fd2444fd3c4d9e071\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.969885 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:13.970059 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:13.969746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4102c584816145f23fcdbb74c30161f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"4102c584816145f23fcdbb74c30161f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:14.062107 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.062006    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.162598 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.162553    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.195077 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.195050    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:14.198053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.198031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:14.263314 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.263259    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.364056 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.364027    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.406051 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.406019    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:14.464607 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.464567    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.498828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.498757    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 21:17:14.499395 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.498999    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 21:17:14.499395 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.499022    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 21:17:14.564894 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.564858    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.566118 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.566077    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 21:12:14 +0000 UTC" deadline="2028-04-26 10:22:21.830361416 +0000 UTC"
Jul 17 21:17:14.566173 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.566119    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15565h5m7.264245471s"
Jul 17 21:17:14.665988 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.665888    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.767012 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.766978    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.867602 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.867550    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:14.873730 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.873702    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:14.894057 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:14.894023    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940dc9292c7a092fd2444fd3c4d9e071.slice/crio-b399966094b1eaebc68c7ca8e6e9727eaec0917a7f60349524b0c91cabf78d13 WatchSource:0}: Error finding container b399966094b1eaebc68c7ca8e6e9727eaec0917a7f60349524b0c91cabf78d13: Status 404 returned error can't find the container with id b399966094b1eaebc68c7ca8e6e9727eaec0917a7f60349524b0c91cabf78d13
Jul 17 21:17:14.894262 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:14.894242    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4102c584816145f23fcdbb74c30161f9.slice/crio-a2db46facf378a481b81b7e200b4e631b1e54713b0ecbb4453d6b8918f6fc9f7 WatchSource:0}: Error finding container a2db46facf378a481b81b7e200b4e631b1e54713b0ecbb4453d6b8918f6fc9f7: Status 404 returned error can't find the container with id a2db46facf378a481b81b7e200b4e631b1e54713b0ecbb4453d6b8918f6fc9f7
Jul 17 21:17:14.898549 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:14.898532    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:17:14.968700 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:14.968593    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:15.069386 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.069359    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 17 21:17:15.125347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.125323    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:15.168164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.168123    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:15.183229 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.183197    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:17:15.184274 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.184258    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 17 21:17:15.194975 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.194953    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:17:15.541864 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.541830    2579 apiserver.go:52] "Watching apiserver"
Jul 17 21:17:15.548617 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.548586    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 21:17:15.549865 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.549827    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-szzck","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm","openshift-cluster-node-tuning-operator/tuned-tnfw2","openshift-dns/node-resolver-5v4pd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","openshift-multus/multus-h2xl8","openshift-network-diagnostics/network-check-target-22qnq","openshift-network-operator/iptables-alerter-c9zb4","kube-system/global-pull-secret-syncer-5vmtj","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal","openshift-image-registry/node-ca-fhtcj","openshift-multus/multus-additional-cni-plugins-9bbjp","openshift-multus/network-metrics-daemon-st68l","openshift-ovn-kubernetes/ovnkube-node-k945n"]
Jul 17 21:17:15.551989 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.551513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:15.551989 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.551596    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:15.553415 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.553389    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.554690 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.554669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.556270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.555877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.556270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.556033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.556270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.556113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 21:17:15.556270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.555883    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-574l5\""
Jul 17 21:17:15.556610 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.556592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.557122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.557089    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.557122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.557114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.557320 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.557090    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56bcr\""
Jul 17 21:17:15.559074 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.559054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.559975 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.559792    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.559975 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.559897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.560148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.560006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pdsk9\""
Jul 17 21:17:15.560357 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.560336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.561466 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.561441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 21:17:15.562624 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.562600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.562723 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.562697    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:15.564590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.564564    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 21:17:15.564685 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.564598    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 21:17:15.565013 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.564994    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.565438    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tk7km\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.565539    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.564574    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.566098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9rlz\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.566112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.566130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 21:17:15.566783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.566676    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.567201 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.567145    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.568127 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.567716    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 21:17:15.571786 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.570955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.571786 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.571047    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:15.576538 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.576284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.578769 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.578769 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-systemd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.578769 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-node-log\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.578769 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-script-lib\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.578769 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr9mt\" (UniqueName: \"kubernetes.io/projected/2418ed64-45c0-4ca5-8de9-7b6d080b338c-kube-api-access-rr9mt\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-system-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-socket-dir-parent\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-etc-kubernetes\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-modprobe-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-systemd-units\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-var-lib-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.578994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-bin\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-var-lib-kubelet\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.579119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-systemd\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-run\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2418ed64-45c0-4ca5-8de9-7b6d080b338c-host\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2418ed64-45c0-4ca5-8de9-7b6d080b338c-serviceca\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-k8s-cni-cncf-io\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-multus-daemon-config\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-config\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-kubelet-config\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-bin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-slash\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zxg6r\""
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-hostroot\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.579614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-multus-certs\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rptk\" (UniqueName: \"kubernetes.io/projected/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-kube-api-access-2rptk\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-lib-modules\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqj8\" (UniqueName: \"kubernetes.io/projected/836ff279-520a-439a-8673-f54cee5c4d6f-kube-api-access-jtqj8\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-ovn\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2d5\" (UniqueName: \"kubernetes.io/projected/410283f8-7b47-4b6a-be61-313ff2eb27b6-kube-api-access-ml2d5\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-netns\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-host\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-tmp\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.579993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-netd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/410283f8-7b47-4b6a-be61-313ff2eb27b6-hosts-file\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-log-socket\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-os-release\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.580409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-kubernetes\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-conf\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-env-overrides\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410283f8-7b47-4b6a-be61-313ff2eb27b6-tmp-dir\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-cnibin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-cni-binary-copy\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-dbus\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-sys\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-etc-tuned\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-etc-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580475    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx6hl\" (UniqueName: \"kubernetes.io/projected/b8cea961-79d8-4ad5-aa96-272f69a2eb53-kube-api-access-zx6hl\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9vv7\" (UniqueName: \"kubernetes.io/projected/286f2d8d-5444-471d-9b09-a3e44578abda-kube-api-access-m9vv7\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-kubelet\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovn-node-metrics-cert\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-conf-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysconfig\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-netns\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-multus\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.580880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-kubelet\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.581125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z7bfd\""
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.581131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 21:17:15.581923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.581599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.582127 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.581982    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 21:17:15.582766 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.582303    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 21:17:15.582766 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.582400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xntmp\""
Jul 17 21:17:15.582766 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.582604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 21:17:15.584035 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.583810    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 21:17:15.584035 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.583827    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kgl8q\""
Jul 17 21:17:15.584035 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.583965    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 21:17:15.604102 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.604068    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzcnl"
Jul 17 21:17:15.612198 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.612168    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzcnl"
Jul 17 21:17:15.667451 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.667420    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 21:17:15.681060 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.681060 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-hostroot\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-multus-certs\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62lfg\" (UniqueName: \"kubernetes.io/projected/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-kube-api-access-62lfg\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rptk\" (UniqueName: \"kubernetes.io/projected/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-kube-api-access-2rptk\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-lib-modules\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqj8\" (UniqueName: \"kubernetes.io/projected/836ff279-520a-439a-8673-f54cee5c4d6f-kube-api-access-jtqj8\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-ovn\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.681305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2d5\" (UniqueName: \"kubernetes.io/projected/410283f8-7b47-4b6a-be61-313ff2eb27b6-kube-api-access-ml2d5\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-netns\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-host\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-tmp\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-netd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/410283f8-7b47-4b6a-be61-313ff2eb27b6-hosts-file\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c14c752-ee73-47a3-9637-4276b3209f72-iptables-alerter-script\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-konnectivity-ca\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-log-socket\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-os-release\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-os-release\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.681695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-kubernetes\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-agent-certs\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-conf\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-env-overrides\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410283f8-7b47-4b6a-be61-313ff2eb27b6-tmp-dir\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-cnibin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-cni-binary-copy\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-dbus\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-sys\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.681961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-etc-tuned\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-etc-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.682325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.682855 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx6hl\" (UniqueName: \"kubernetes.io/projected/b8cea961-79d8-4ad5-aa96-272f69a2eb53-kube-api-access-zx6hl\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.682855 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9vv7\" (UniqueName: \"kubernetes.io/projected/286f2d8d-5444-471d-9b09-a3e44578abda-kube-api-access-m9vv7\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.682855 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxqr6\" (UniqueName: \"kubernetes.io/projected/9c14c752-ee73-47a3-9637-4276b3209f72-kube-api-access-nxqr6\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.682855 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.682855 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-kubelet\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovn-node-metrics-cert\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-conf-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.683153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.682977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.683153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c14c752-ee73-47a3-9637-4276b3209f72-host-slash\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.683153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.683411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:15.683411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysconfig\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.683411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-netns\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-multus\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.683597 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-kubelet\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.683647 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-systemd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683704 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-node-log\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683762 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-script-lib\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.683762 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr9mt\" (UniqueName: \"kubernetes.io/projected/2418ed64-45c0-4ca5-8de9-7b6d080b338c-kube-api-access-rr9mt\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.683893 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.683782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-system-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.684097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-socket-dir-parent\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.684199 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-etc-kubernetes\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.684199 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-socket-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.684320 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-modprobe-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.684320 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-systemd-units\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.684426 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-var-lib-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.684426 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.684529 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-bin\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.684529 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cnibin\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.684529 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-var-lib-kubelet\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.684682 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.684682 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nnz\" (UniqueName: \"kubernetes.io/projected/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kube-api-access-t7nnz\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.684787 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.684787 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.684991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.684973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-systemd\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.685070 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-run\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.685131 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2418ed64-45c0-4ca5-8de9-7b6d080b338c-host\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.685314 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2418ed64-45c0-4ca5-8de9-7b6d080b338c-serviceca\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.685393 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-k8s-cni-cncf-io\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.685393 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-multus-daemon-config\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.685500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-registration-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.685500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-config\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.685721 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-kubelet-config\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.685832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-bin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.685832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-device-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.685941 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-sys-fs\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.685941 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.685884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-system-cni-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.686080 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.686062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.686159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.686103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-slash\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.688002 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.687973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.688115 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.688009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-hostroot\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.688115 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.688094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-multus-certs\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.688428 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.688405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-ovn\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.688894 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.688872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-lib-modules\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.689860 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.689823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-netns\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.689956 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.689919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-host\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.689956 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.689921    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:15.690063 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.689981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-netns\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.690063 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.690039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:16.1900048 +0000 UTC m=+2.971264513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:15.690063 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-netd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.690230 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.690230 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/410283f8-7b47-4b6a-be61-313ff2eb27b6-hosts-file\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.690348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-log-socket\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.690453 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690416    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 21:17:15.690655 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-os-release\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.690826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-kubernetes\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.690904 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-multus\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.690951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-kubelet\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.691005 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-conf\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.691057 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.690997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-systemd\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.691109 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.691063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-node-log\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.691432 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.691410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410283f8-7b47-4b6a-be61-313ff2eb27b6-tmp-dir\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.691535 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.691518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-cnibin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.691682 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.691653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-env-overrides\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.692232 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.692210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-cni-binary-copy\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.692497 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.692473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-script-lib\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.692497 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.692490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-dbus\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.692687 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.692667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-sys\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.693020 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.692994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-system-cni-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.693120 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-socket-dir-parent\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.693190 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-etc-kubernetes\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.693341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-modprobe-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.693400 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-systemd-units\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.693474 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-var-lib-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.693560 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-run-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.693648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-cni-bin\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.693793 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-var-lib-kubelet\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.693909 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.693892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-etc-openvswitch\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.694502 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.694480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/286f2d8d-5444-471d-9b09-a3e44578abda-multus-daemon-config\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.694671 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.694655    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:15.694760 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.694748    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:16.194720515 +0000 UTC m=+2.975980230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:15.694900 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.694826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-systemd\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.694954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.694916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-run\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.695002 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.694975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2418ed64-45c0-4ca5-8de9-7b6d080b338c-host\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.695384 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.695357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-run-k8s-cni-cncf-io\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.695459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-host-var-lib-cni-bin\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.695939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0f64e890-db24-4c2d-bdc6-35d0dac52b57-kubelet-config\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286f2d8d-5444-471d-9b09-a3e44578abda-multus-conf-dir\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovnkube-config\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-kubelet\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-run-ovn-kubernetes\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysconfig\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.696977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/836ff279-520a-439a-8673-f54cee5c4d6f-etc-sysctl-d\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.697427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.696997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8cea961-79d8-4ad5-aa96-272f69a2eb53-host-slash\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.698743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.698605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-etc-tuned\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.699262 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.699177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2418ed64-45c0-4ca5-8de9-7b6d080b338c-serviceca\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.699603 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.699549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836ff279-520a-439a-8673-f54cee5c4d6f-tmp\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.701237 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.701213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8cea961-79d8-4ad5-aa96-272f69a2eb53-ovn-node-metrics-cert\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.705993 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.705967    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:15.705993 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.705998    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:15.706172 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.706015    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:15.706274 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:15.706258    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:16.206237335 +0000 UTC m=+2.987497062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:15.708295 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.708175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr9mt\" (UniqueName: \"kubernetes.io/projected/2418ed64-45c0-4ca5-8de9-7b6d080b338c-kube-api-access-rr9mt\") pod \"node-ca-fhtcj\" (UID: \"2418ed64-45c0-4ca5-8de9-7b6d080b338c\") " pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.710639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.710611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2d5\" (UniqueName: \"kubernetes.io/projected/410283f8-7b47-4b6a-be61-313ff2eb27b6-kube-api-access-ml2d5\") pod \"node-resolver-5v4pd\" (UID: \"410283f8-7b47-4b6a-be61-313ff2eb27b6\") " pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.710751 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.710655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx6hl\" (UniqueName: \"kubernetes.io/projected/b8cea961-79d8-4ad5-aa96-272f69a2eb53-kube-api-access-zx6hl\") pod \"ovnkube-node-k945n\" (UID: \"b8cea961-79d8-4ad5-aa96-272f69a2eb53\") " pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.711183 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.711160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rptk\" (UniqueName: \"kubernetes.io/projected/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-kube-api-access-2rptk\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:15.713008 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.712956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqj8\" (UniqueName: \"kubernetes.io/projected/836ff279-520a-439a-8673-f54cee5c4d6f-kube-api-access-jtqj8\") pod \"tuned-tnfw2\" (UID: \"836ff279-520a-439a-8673-f54cee5c4d6f\") " pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.715177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.714332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9vv7\" (UniqueName: \"kubernetes.io/projected/286f2d8d-5444-471d-9b09-a3e44578abda-kube-api-access-m9vv7\") pod \"multus-h2xl8\" (UID: \"286f2d8d-5444-471d-9b09-a3e44578abda\") " pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.761717 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.761651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"940dc9292c7a092fd2444fd3c4d9e071","Type":"ContainerStarted","Data":"b399966094b1eaebc68c7ca8e6e9727eaec0917a7f60349524b0c91cabf78d13"}
Jul 17 21:17:15.764477 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.764440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"4102c584816145f23fcdbb74c30161f9","Type":"ContainerStarted","Data":"a2db46facf378a481b81b7e200b4e631b1e54713b0ecbb4453d6b8918f6fc9f7"}
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxqr6\" (UniqueName: \"kubernetes.io/projected/9c14c752-ee73-47a3-9637-4276b3209f72-kube-api-access-nxqr6\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c14c752-ee73-47a3-9637-4276b3209f72-host-slash\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-socket-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cnibin\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nnz\" (UniqueName: \"kubernetes.io/projected/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kube-api-access-t7nnz\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-registration-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-device-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-sys-fs\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-system-cni-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.788107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62lfg\" (UniqueName: \"kubernetes.io/projected/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-kube-api-access-62lfg\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c14c752-ee73-47a3-9637-4276b3209f72-iptables-alerter-script\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-konnectivity-ca\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-os-release\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.787651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-agent-certs\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-device-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788232    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-registration-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-socket-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-sys-fs\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-system-cni-dir\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cnibin\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.789308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.788743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c14c752-ee73-47a3-9637-4276b3209f72-host-slash\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.790194 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.789017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-os-release\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.790194 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.789102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c14c752-ee73-47a3-9637-4276b3209f72-iptables-alerter-script\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.790194 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.789227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-konnectivity-ca\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.790917 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.790891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15e71d0c-1b82-4d68-8bb0-5101dc7cc546-agent-certs\") pod \"konnectivity-agent-szzck\" (UID: \"15e71d0c-1b82-4d68-8bb0-5101dc7cc546\") " pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.803756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.803680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxqr6\" (UniqueName: \"kubernetes.io/projected/9c14c752-ee73-47a3-9637-4276b3209f72-kube-api-access-nxqr6\") pod \"iptables-alerter-c9zb4\" (UID: \"9c14c752-ee73-47a3-9637-4276b3209f72\") " pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.804441 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.804417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62lfg\" (UniqueName: \"kubernetes.io/projected/7e3b4b11-9d18-46c8-b054-f67cb80b7be7-kube-api-access-62lfg\") pod \"multus-additional-cni-plugins-9bbjp\" (UID: \"7e3b4b11-9d18-46c8-b054-f67cb80b7be7\") " pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.804959 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.804937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nnz\" (UniqueName: \"kubernetes.io/projected/7ce15c5e-9e6c-46b9-90df-be51f38e5b53-kube-api-access-t7nnz\") pod \"aws-ebs-csi-driver-node-5wvnm\" (UID: \"7ce15c5e-9e6c-46b9-90df-be51f38e5b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.874235 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.874206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fhtcj"
Jul 17 21:17:15.881494 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.881461    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnfw2"
Jul 17 21:17:15.890910 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.890864    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5v4pd"
Jul 17 21:17:15.899498 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.899472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:15.901994 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.901960    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2418ed64_45c0_4ca5_8de9_7b6d080b338c.slice/crio-a3c40e5d708733769d02fa466bec4d9ceb97a1562e32e9fbe1d726e3a822ed2e WatchSource:0}: Error finding container a3c40e5d708733769d02fa466bec4d9ceb97a1562e32e9fbe1d726e3a822ed2e: Status 404 returned error can't find the container with id a3c40e5d708733769d02fa466bec4d9ceb97a1562e32e9fbe1d726e3a822ed2e
Jul 17 21:17:15.906265 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.906235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2xl8"
Jul 17 21:17:15.914160 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.914083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm"
Jul 17 21:17:15.922161 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.922125    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410283f8_7b47_4b6a_be61_313ff2eb27b6.slice/crio-d55dbda9a7fd65413b6d6d44998df1412e5fbfee4a7bdaf44f8fd2a668ccd47e WatchSource:0}: Error finding container d55dbda9a7fd65413b6d6d44998df1412e5fbfee4a7bdaf44f8fd2a668ccd47e: Status 404 returned error can't find the container with id d55dbda9a7fd65413b6d6d44998df1412e5fbfee4a7bdaf44f8fd2a668ccd47e
Jul 17 21:17:15.925679 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.925568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9zb4"
Jul 17 21:17:15.931411 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.931378    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8cea961_79d8_4ad5_aa96_272f69a2eb53.slice/crio-0f7f03db74830c022177524426264bd02ae06542b34df4ddb7dd4a5374812c3a WatchSource:0}: Error finding container 0f7f03db74830c022177524426264bd02ae06542b34df4ddb7dd4a5374812c3a: Status 404 returned error can't find the container with id 0f7f03db74830c022177524426264bd02ae06542b34df4ddb7dd4a5374812c3a
Jul 17 21:17:15.933169 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.933141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286f2d8d_5444_471d_9b09_a3e44578abda.slice/crio-f2a94fe7648b128f2c1f0a07bef5dac4ad1a111bee5186b7c346f7fe5ad07dbd WatchSource:0}: Error finding container f2a94fe7648b128f2c1f0a07bef5dac4ad1a111bee5186b7c346f7fe5ad07dbd: Status 404 returned error can't find the container with id f2a94fe7648b128f2c1f0a07bef5dac4ad1a111bee5186b7c346f7fe5ad07dbd
Jul 17 21:17:15.934279 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.934255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:15.940223 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.940200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bbjp"
Jul 17 21:17:15.945397 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.945347    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c14c752_ee73_47a3_9637_4276b3209f72.slice/crio-681acd4577f6b73c7a88fe38e5f85eccd3164227be86fcf334bfdd95eaa37ba8 WatchSource:0}: Error finding container 681acd4577f6b73c7a88fe38e5f85eccd3164227be86fcf334bfdd95eaa37ba8: Status 404 returned error can't find the container with id 681acd4577f6b73c7a88fe38e5f85eccd3164227be86fcf334bfdd95eaa37ba8
Jul 17 21:17:15.953984 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.953936    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e71d0c_1b82_4d68_8bb0_5101dc7cc546.slice/crio-3ba34718bf247e7bfbdbd1b7da2246aa4eac6c1599f6f94ec9633b6205f5332a WatchSource:0}: Error finding container 3ba34718bf247e7bfbdbd1b7da2246aa4eac6c1599f6f94ec9633b6205f5332a: Status 404 returned error can't find the container with id 3ba34718bf247e7bfbdbd1b7da2246aa4eac6c1599f6f94ec9633b6205f5332a
Jul 17 21:17:15.958050 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:17:15.958021    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3b4b11_9d18_46c8_b054_f67cb80b7be7.slice/crio-0e4c4746f81e591f011a2847c61ac9ee25d9a8ee005fb943f991f7b1e3780574 WatchSource:0}: Error finding container 0e4c4746f81e591f011a2847c61ac9ee25d9a8ee005fb943f991f7b1e3780574: Status 404 returned error can't find the container with id 0e4c4746f81e591f011a2847c61ac9ee25d9a8ee005fb943f991f7b1e3780574
Jul 17 21:17:15.996458 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:15.996423    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:16.191522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.191438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:16.191698 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.191635    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:16.191763 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.191722    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:17.191700929 +0000 UTC m=+3.972960641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:16.292223 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.292178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:16.292384 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.292246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:16.292463 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292410    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:16.292463 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292442    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:16.292463 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292453    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:16.292595 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292415    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:16.292595 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292518    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:17.29250074 +0000 UTC m=+4.073760473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:16.292595 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.292586    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:17.2925681 +0000 UTC m=+4.073827832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:16.614798 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.614624    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 21:12:16 +0000 UTC" deadline="2028-04-16 21:02:45.73429261 +0000 UTC"
Jul 17 21:17:16.614798 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.614722    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15335h45m29.119593668s"
Jul 17 21:17:16.757090 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.757038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:16.757260 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.757197    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:16.757744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.757700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:16.757991 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:16.757859    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:16.771553 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.771433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5v4pd" event={"ID":"410283f8-7b47-4b6a-be61-313ff2eb27b6","Type":"ContainerStarted","Data":"d55dbda9a7fd65413b6d6d44998df1412e5fbfee4a7bdaf44f8fd2a668ccd47e"}
Jul 17 21:17:16.773300 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.773207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnfw2" event={"ID":"836ff279-520a-439a-8673-f54cee5c4d6f","Type":"ContainerStarted","Data":"a654a2dd582c89a9a01c04c6fda8100be167cc27edd92b9b84db1b57863a8d3c"}
Jul 17 21:17:16.775685 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.775600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szzck" event={"ID":"15e71d0c-1b82-4d68-8bb0-5101dc7cc546","Type":"ContainerStarted","Data":"3ba34718bf247e7bfbdbd1b7da2246aa4eac6c1599f6f94ec9633b6205f5332a"}
Jul 17 21:17:16.777779 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.777703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm" event={"ID":"7ce15c5e-9e6c-46b9-90df-be51f38e5b53","Type":"ContainerStarted","Data":"b8e697f8b8d3100761be2055ae0e0c3cc8d6903acc5bd9dd0b7d670e035e822b"}
Jul 17 21:17:16.780234 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.780201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"0f7f03db74830c022177524426264bd02ae06542b34df4ddb7dd4a5374812c3a"}
Jul 17 21:17:16.787021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.786988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fhtcj" event={"ID":"2418ed64-45c0-4ca5-8de9-7b6d080b338c","Type":"ContainerStarted","Data":"a3c40e5d708733769d02fa466bec4d9ceb97a1562e32e9fbe1d726e3a822ed2e"}
Jul 17 21:17:16.797718 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.797679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerStarted","Data":"0e4c4746f81e591f011a2847c61ac9ee25d9a8ee005fb943f991f7b1e3780574"}
Jul 17 21:17:16.802084 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.802051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9zb4" event={"ID":"9c14c752-ee73-47a3-9637-4276b3209f72","Type":"ContainerStarted","Data":"681acd4577f6b73c7a88fe38e5f85eccd3164227be86fcf334bfdd95eaa37ba8"}
Jul 17 21:17:16.803953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:16.803885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2xl8" event={"ID":"286f2d8d-5444-471d-9b09-a3e44578abda","Type":"ContainerStarted","Data":"f2a94fe7648b128f2c1f0a07bef5dac4ad1a111bee5186b7c346f7fe5ad07dbd"}
Jul 17 21:17:17.093592 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.093557    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:17:17.201350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.200691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:17.201350 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.200852    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:17.201350 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.200965    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:19.200943899 +0000 UTC m=+5.982203607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:17.301788 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.301750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:17.301993 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.301832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:17.301993 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.301975    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:17.302125 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.302104    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:19.302021978 +0000 UTC m=+6.083281704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:17.302642 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.302605    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:17.302769 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.302674    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:17.302769 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.302689    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:17.302769 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.302753    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:19.302736176 +0000 UTC m=+6.083995899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:17.615742 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.615642    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 21:12:16 +0000 UTC" deadline="2028-03-16 09:36:45.684943795 +0000 UTC"
Jul 17 21:17:17.615742 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.615696    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14580h19m28.069253565s"
Jul 17 21:17:17.757767 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:17.757730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:17.758011 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:17.757916    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:18.757143 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:18.757106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:18.757640 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:18.757261    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:18.757716 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:18.757674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:18.757830 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:18.757774    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:19.220178 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:19.219427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:19.220178 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.219650    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:19.220178 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.219722    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:23.219699903 +0000 UTC m=+10.000959616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:19.320315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:19.320384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.320633    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.320701    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:23.320681598 +0000 UTC m=+10.101941306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.321193    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.321212    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.321224    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:19.321329 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.321272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:23.321255346 +0000 UTC m=+10.102515068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:19.759309 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:19.759274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:19.759812 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:19.759425    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:20.758217 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:20.757349    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:20.758217 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:20.757539    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:20.758217 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:20.758032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:20.758217 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:20.758139    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:21.757155 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:21.756897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:21.757651 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:21.757281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:22.757305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:22.757258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:22.757826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:22.757258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:22.757826 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:22.757453    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:22.757826 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:22.757508    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:23.255284 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:23.255242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:23.255459 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.255414    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:23.255517 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.255473    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:31.255457573 +0000 UTC m=+18.036717281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:23.356480 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:23.356379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:23.356480 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:23.356462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:23.356707 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.356638    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:23.356707 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.356705    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:31.356683924 +0000 UTC m=+18.137943637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:23.357043 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.357005    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:23.357043 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.357038    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:23.357181 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.357052    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:23.357181 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.357111    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:31.357092171 +0000 UTC m=+18.138351894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:23.758222 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:23.758130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:23.758713 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:23.758257    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:24.757312 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:24.756620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:24.757312 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:24.756772    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:24.757312 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:24.757166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:24.757312 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:24.757237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:25.758144 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:25.758005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:25.758613 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:25.758193    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:26.756226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:26.756193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:26.756226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:26.756223    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:26.756452 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:26.756325    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:26.756500 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:26.756473    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:27.756660 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:27.756622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:27.757148 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:27.756782    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:28.756348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:28.756316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:28.756348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:28.756363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:28.756581 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:28.756451    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:28.756642 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:28.756591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:29.757373 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:29.757336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:29.757834 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:29.757492    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:30.757207 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:30.757168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:30.757459 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:30.757168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:30.757459 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:30.757304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:30.757459 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:30.757384    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:31.323612 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:31.323571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:31.323846 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.323718    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:31.323846 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.323818    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:47.32379691 +0000 UTC m=+34.105056628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:31.424542 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:31.424506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:31.424717 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:31.424558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:31.424717 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424682    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:31.424717 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424683    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:31.424717 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424710    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:31.424717 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424722    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:31.424936 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424752    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:47.424734026 +0000 UTC m=+34.205993745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:31.424936 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.424789    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:17:47.424779641 +0000 UTC m=+34.206039347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:31.756298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:31.756248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:31.756451 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:31.756392    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:32.756526 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:32.756490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:32.757004 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:32.756623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:32.757004 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:32.756658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:32.757004 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:32.756723    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:33.757508 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:33.757464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:33.757946 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:33.757605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:34.756952 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:34.756919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:34.757147 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:34.757053    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:34.757147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:34.757105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:34.757255 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:34.757197    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:35.757297 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:35.757266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:35.757878 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:35.757401    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:36.756522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.756367    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:36.756618 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:36.756594    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:36.756677 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.756665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:36.756728 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:36.756715    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:36.845985 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.845866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2xl8" event={"ID":"286f2d8d-5444-471d-9b09-a3e44578abda","Type":"ContainerStarted","Data":"60346cbc675b6fd4bd36032dae08a8a7f0773195cffafeab2969baa8790c2f3c"}
Jul 17 21:17:36.848390 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.848239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnfw2" event={"ID":"836ff279-520a-439a-8673-f54cee5c4d6f","Type":"ContainerStarted","Data":"6472ac1aa66849d3d27741b19d3236512cf5f145e8c245555e68bab8b33fe419"}
Jul 17 21:17:36.850429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.850398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"940dc9292c7a092fd2444fd3c4d9e071","Type":"ContainerStarted","Data":"1c57d5ac9fccde3a0ec96fb39f3ce5d09c829e1436cf46af564e6216d1c197a2"}
Jul 17 21:17:36.853149 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.853123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"07a67e651e5065e0028915b188886197fe22fcae2fe4d9ebef478da4343ad7ac"}
Jul 17 21:17:36.853265 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.853197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"01dd7e14c7fe9bd6f6053300c52ab1d4220560780e36bdf7185ba02480f9f470"}
Jul 17 21:17:36.867630 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.867549    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h2xl8" podStartSLOduration=2.257557062 podStartE2EDuration="22.867525874s" totalImagesPullingTime="20.609968812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:36.86617822 +0000 UTC m=+23.647437957" watchObservedRunningTime="2026-07-17 21:17:36.867525874 +0000 UTC m=+23.648785603"
Jul 17 21:17:36.882865 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.882789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" podStartSLOduration=20.8826506 podStartE2EDuration="20.8826506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:36.882384901 +0000 UTC m=+23.663644630" watchObservedRunningTime="2026-07-17 21:17:36.8826506 +0000 UTC m=+23.663910322"
Jul 17 21:17:36.903706 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:36.903082    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnfw2" podStartSLOduration=2.35664213 podStartE2EDuration="22.90304774s" totalImagesPullingTime="20.54640561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:36.902966155 +0000 UTC m=+23.684225884" watchObservedRunningTime="2026-07-17 21:17:36.90304774 +0000 UTC m=+23.684307468"
Jul 17 21:17:37.757393 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.757208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:37.757593 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:37.757508    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:37.857386 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.857346    2579 generic.go:356] "Generic (PLEG): container finished" podID="4102c584816145f23fcdbb74c30161f9" containerID="a5ca12eba9355f2cea666d4d445f7ac4cb8c369dff1df577cd21a54cba7aa066" exitCode=0
Jul 17 21:17:37.857861 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.857454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"4102c584816145f23fcdbb74c30161f9","Type":"ContainerDied","Data":"a5ca12eba9355f2cea666d4d445f7ac4cb8c369dff1df577cd21a54cba7aa066"}
Jul 17 21:17:37.859413 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.859383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szzck" event={"ID":"15e71d0c-1b82-4d68-8bb0-5101dc7cc546","Type":"ContainerStarted","Data":"dfd59a860018ec9d03858367254e24e917780fc05a4601e037bf66b95ab58aa7"}
Jul 17 21:17:37.861239 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.861215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm" event={"ID":"7ce15c5e-9e6c-46b9-90df-be51f38e5b53","Type":"ContainerStarted","Data":"4327b911ff36198b2cfbcf41f0ee327efa8c830fb9b6517c54215c8c3f248584"}
Jul 17 21:17:37.864448 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.864426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"88706a348b0ba3d95abbbf15bbb507a792667655868d75ca2d95a991eda8906f"}
Jul 17 21:17:37.864554 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.864502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"ff0ce3c57d6f18955a9db910a6a1ba84f047d324cdc49b86b6a32b74182ed848"}
Jul 17 21:17:37.864608 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.864559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"8f8fa8d99c0fdf124d9aeeabc3d7604b949f57911972ce7a361c253cc5b7931c"}
Jul 17 21:17:37.864645 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.864607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"125f67875ff9a13238829e46822b5678db2f9c21ccbd023103430ba3d836635a"}
Jul 17 21:17:37.866068 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.866036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fhtcj" event={"ID":"2418ed64-45c0-4ca5-8de9-7b6d080b338c","Type":"ContainerStarted","Data":"8a56c52f54d29abb708d226bbe5c771c725ee4cc2849e4b3973121c12aac1db0"}
Jul 17 21:17:37.867672 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.867650    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="ac072c840ee5827164c624e9454af5797bc4a7dab94ee41f58720d1a01c01c86" exitCode=0
Jul 17 21:17:37.867777 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.867727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"ac072c840ee5827164c624e9454af5797bc4a7dab94ee41f58720d1a01c01c86"}
Jul 17 21:17:37.869129 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.869110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9zb4" event={"ID":"9c14c752-ee73-47a3-9637-4276b3209f72","Type":"ContainerStarted","Data":"672c87faf30b5308b5cb73724bfe60d8206710e26f1c18a5349e7a66c2c22b73"}
Jul 17 21:17:37.870805 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.870784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5v4pd" event={"ID":"410283f8-7b47-4b6a-be61-313ff2eb27b6","Type":"ContainerStarted","Data":"555d03f14220d9fad3ec0e77240e517e6c0a9b658689a22bbbccfad15fc57aa8"}
Jul 17 21:17:37.888444 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.888392    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5v4pd" podStartSLOduration=3.351265064 podStartE2EDuration="23.888376687s" totalImagesPullingTime="20.537111623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:37.88797566 +0000 UTC m=+24.669235396" watchObservedRunningTime="2026-07-17 21:17:37.888376687 +0000 UTC m=+24.669636413"
Jul 17 21:17:37.904493 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.904427    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c9zb4" podStartSLOduration=3.391975176 podStartE2EDuration="23.904405593s" totalImagesPullingTime="20.512430417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:37.904338547 +0000 UTC m=+24.685598314" watchObservedRunningTime="2026-07-17 21:17:37.904405593 +0000 UTC m=+24.685665323"
Jul 17 21:17:37.942922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.942861    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fhtcj" podStartSLOduration=3.388353409 podStartE2EDuration="23.942841482s" totalImagesPullingTime="20.554488073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:37.942832565 +0000 UTC m=+24.724092294" watchObservedRunningTime="2026-07-17 21:17:37.942841482 +0000 UTC m=+24.724101211"
Jul 17 21:17:37.961573 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:37.961522    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-szzck" podStartSLOduration=8.249406465 podStartE2EDuration="23.961505388s" totalImagesPullingTime="15.712098923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:37.961284967 +0000 UTC m=+24.742544694" watchObservedRunningTime="2026-07-17 21:17:37.961505388 +0000 UTC m=+24.742765186"
Jul 17 21:17:38.420200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.420163    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 21:17:38.658067 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.657894    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T21:17:38.420193299Z","UUID":"dbe11d01-85d3-44b2-9417-b5f3d936355f","Handler":null,"Name":"","Endpoint":""}
Jul 17 21:17:38.659643 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.659620    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 21:17:38.659815 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.659682    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 21:17:38.756270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.756202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:38.756270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.756222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:38.756577 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:38.756315    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:38.756577 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:38.756464    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:38.875109 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.875070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"4102c584816145f23fcdbb74c30161f9","Type":"ContainerStarted","Data":"f7cdcbd6dfdc2ffd799eac007b04d4667c2e424f7d69f2d45ba94bf9420b7812"}
Jul 17 21:17:38.877208 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.877172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm" event={"ID":"7ce15c5e-9e6c-46b9-90df-be51f38e5b53","Type":"ContainerStarted","Data":"4a481caf792ebd42ba622b08477cdeb79bc78d20f06b98bc460b92ff83893192"}
Jul 17 21:17:38.902269 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:38.902201    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" podStartSLOduration=22.902185143 podStartE2EDuration="22.902185143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:38.901914624 +0000 UTC m=+25.683174351" watchObservedRunningTime="2026-07-17 21:17:38.902185143 +0000 UTC m=+25.683444870"
Jul 17 21:17:39.275425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.275394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:39.276156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.276137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:39.756999 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.756953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:39.757176 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:39.757106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:39.883264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.883171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"20ae1c9fe40462966a892d5234b88871101f62131d2657c39eeb4d9a41de5074"}
Jul 17 21:17:39.883745 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.883443    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:39.883925 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:39.883905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-szzck"
Jul 17 21:17:40.756616 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:40.756583    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:40.756832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:40.756583    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:40.756832 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:40.756701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:40.756832 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:40.756783    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:40.888294 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:40.888260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm" event={"ID":"7ce15c5e-9e6c-46b9-90df-be51f38e5b53","Type":"ContainerStarted","Data":"bb5486a5a3d289d47b161dbb2ab9e92c4900d4ad0f2942d34fd51f0162106da7"}
Jul 17 21:17:40.915040 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:40.914972    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wvnm" podStartSLOduration=3.472530067 podStartE2EDuration="26.914950668s" totalImagesPullingTime="23.442420601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:40.91430153 +0000 UTC m=+27.695561259" watchObservedRunningTime="2026-07-17 21:17:40.914950668 +0000 UTC m=+27.696210398"
Jul 17 21:17:41.756379 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:41.756341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:41.756579 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:41.756489    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:42.757052 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.756881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:42.757814 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.756882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:42.757814 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:42.757151    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:42.757814 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:42.757196    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:42.896281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.896184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" event={"ID":"b8cea961-79d8-4ad5-aa96-272f69a2eb53","Type":"ContainerStarted","Data":"eb8b89432554e116862d4df19ce9406d1742e2dacae8e626bfa5c1481d8d0965"}
Jul 17 21:17:42.896496 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.896477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:42.898151 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.898127    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="0ffcddf9db731cde247eb612788071d07d373908357c14bdc238312ef5eb93c9" exitCode=0
Jul 17 21:17:42.898294 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.898169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"0ffcddf9db731cde247eb612788071d07d373908357c14bdc238312ef5eb93c9"}
Jul 17 21:17:42.912870 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.912843    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:42.929485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:42.929438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k945n" podStartSLOduration=8.339455879 podStartE2EDuration="28.929422568s" totalImagesPullingTime="20.589966689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:42.928795947 +0000 UTC m=+29.710055683" watchObservedRunningTime="2026-07-17 21:17:42.929422568 +0000 UTC m=+29.710682296"
Jul 17 21:17:43.757905 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:43.757869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:43.758372 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:43.757973    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:43.901109 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:43.901078    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:43.901260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:43.901164    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:43.918258 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:43.918230    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:17:44.685323 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.685131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22qnq"]
Jul 17 21:17:44.685484 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.685382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:44.685484 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:44.685457    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:44.688446 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.688420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-st68l"]
Jul 17 21:17:44.688587 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.688529    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:44.688673 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:44.688649    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:44.689128 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.689099    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vmtj"]
Jul 17 21:17:44.689222 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.689208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:44.689315 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:44.689297    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:44.907142 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.907110    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="eeb426228f919ab4970127311f7c80710acd23b74a548e6d35fb98ef2b52b9e9" exitCode=0
Jul 17 21:17:44.907570 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:44.907182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"eeb426228f919ab4970127311f7c80710acd23b74a548e6d35fb98ef2b52b9e9"}
Jul 17 21:17:46.281683 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.281656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5v4pd_410283f8-7b47-4b6a-be61-313ff2eb27b6/dns-node-resolver/0.log"
Jul 17 21:17:46.756704 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.756612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:46.756890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.756613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:46.756890 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:46.756722    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:46.756890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.756613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:46.756890 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:46.756853    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:46.757032 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:46.756935    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:46.914397 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.914359    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="5436dcbbf45b09a6eb04e8c5d4ae79c1246e748a286c7e7270ce3102a447b69d" exitCode=0
Jul 17 21:17:46.914537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:46.914440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"5436dcbbf45b09a6eb04e8c5d4ae79c1246e748a286c7e7270ce3102a447b69d"}
Jul 17 21:17:47.333881 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:47.333834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:47.334380 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.333972    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:47.334380 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.334046    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret podName:0f64e890-db24-4c2d-bdc6-35d0dac52b57 nodeName:}" failed. No retries permitted until 2026-07-17 21:18:19.334026977 +0000 UTC m=+66.115286702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret") pod "global-pull-secret-syncer-5vmtj" (UID: "0f64e890-db24-4c2d-bdc6-35d0dac52b57") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:17:47.434382 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:47.434350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:47.434530 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:47.434410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:47.434530 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434526    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:17:47.434625 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434523    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:47.434625 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434545    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:17:47.434625 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434559    2579 projected.go:196] Error preparing data for projected volume kube-api-access-cp6th for pod openshift-network-diagnostics/network-check-target-22qnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:47.434625 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434609    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th podName:c3e4a5a6-e921-4932-8a4e-151117c95c12 nodeName:}" failed. No retries permitted until 2026-07-17 21:18:19.434589875 +0000 UTC m=+66.215849581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cp6th" (UniqueName: "kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th") pod "network-check-target-22qnq" (UID: "c3e4a5a6-e921-4932-8a4e-151117c95c12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:17:47.434625 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:47.434628    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs podName:a150c5d0-edb0-4e35-86e6-24ecfbcf3582 nodeName:}" failed. No retries permitted until 2026-07-17 21:18:19.434619173 +0000 UTC m=+66.215878883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs") pod "network-metrics-daemon-st68l" (UID: "a150c5d0-edb0-4e35-86e6-24ecfbcf3582") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:17:47.468830 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:47.468805    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fhtcj_2418ed64-45c0-4ca5-8de9-7b6d080b338c/node-ca/0.log"
Jul 17 21:17:48.756485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:48.756448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:48.756966 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:48.756452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:48.756966 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:48.756582    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:48.756966 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:48.756650    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:48.756966 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:48.756452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:48.756966 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:48.756748    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:50.756305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:50.756253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:50.756834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:50.756321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:50.756834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:50.756441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:50.756834 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:50.756456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:50.756834 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:50.756519    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:50.756834 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:50.756577    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:51.928991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:51.928811    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="87a0b399c7a8a445cd9a9b89d7a40395d24b583c7f94817f60afb9a3826fce2c" exitCode=0
Jul 17 21:17:51.928991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:51.928899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"87a0b399c7a8a445cd9a9b89d7a40395d24b583c7f94817f60afb9a3826fce2c"}
Jul 17 21:17:52.756620 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:52.756581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:52.756620 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:52.756627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:52.756866 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:52.756638    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:52.756866 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:52.756719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:52.756866 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:52.756843    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:52.756959 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:52.756910    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:52.934755 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:52.934723    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e3b4b11-9d18-46c8-b054-f67cb80b7be7" containerID="af4f1bcf2f232cd66545689f8bf779701230387e56bc3bd97716eb977c50b03e" exitCode=0
Jul 17 21:17:52.935201 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:52.934796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerDied","Data":"af4f1bcf2f232cd66545689f8bf779701230387e56bc3bd97716eb977c50b03e"}
Jul 17 21:17:53.940596 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:53.940559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" event={"ID":"7e3b4b11-9d18-46c8-b054-f67cb80b7be7","Type":"ContainerStarted","Data":"1e17787b360f135c95cf8f605fd1355933f981f04c44f6968e74518cfd3ef52e"}
Jul 17 21:17:53.993481 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:53.993427    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9bbjp" podStartSLOduration=8.481821306 podStartE2EDuration="39.993413291s" totalImagesPullingTime="31.511591985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:53.977237084 +0000 UTC m=+40.758496809" watchObservedRunningTime="2026-07-17 21:17:53.993413291 +0000 UTC m=+40.774673018"
Jul 17 21:17:54.756719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:54.756684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:54.756719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:54.756712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:54.756970 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:54.756697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:54.756970 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:54.756843    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:54.757078 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:54.756976    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:54.757078 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:54.757045    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:56.757224 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:56.757192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:56.757224 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:56.757233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:56.757724 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:56.757196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:56.757724 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:56.757309    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:56.757724 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:56.757383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:56.757724 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:56.757462    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:17:58.756989 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:58.756951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:17:58.756989 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:58.756973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:17:58.756989 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:17:58.756979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:17:58.757430 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:58.757095    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:17:58.757430 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:58.757209    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:17:58.757430 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:17:58.757285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:00.757002 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:00.756968    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:00.757002 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:00.756992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:00.757413 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:00.756966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:00.757413 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:00.757073    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:18:00.757413 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:00.757138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:00.757413 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:00.757221    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:18:02.756453 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:02.756412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:02.756453 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:02.756449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:02.756453 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:02.756458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:02.756939 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:02.756549    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:02.756939 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:02.756660    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:18:02.756939 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:02.756717    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:18:04.756335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:04.756301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:04.756335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:04.756301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:04.756810 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:04.756313    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:04.756810 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:04.756422    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:18:04.756810 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:04.756454    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:18:04.756810 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:04.756532    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:06.756689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:06.756653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:06.757224 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:06.756657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:06.757224 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:06.756779    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:18:06.757224 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:06.756873    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:18:06.757224 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:06.756657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:06.757224 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:06.756936    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:08.756621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:08.756593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:08.757024 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:08.756593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:08.757024 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:08.756714    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-st68l" podUID="a150c5d0-edb0-4e35-86e6-24ecfbcf3582"
Jul 17 21:18:08.757024 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:08.756821    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22qnq" podUID="c3e4a5a6-e921-4932-8a4e-151117c95c12"
Jul 17 21:18:08.757024 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:08.756593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:08.757024 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:08.756915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vmtj" podUID="0f64e890-db24-4c2d-bdc6-35d0dac52b57"
Jul 17 21:18:10.524387 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.524365    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeReady"
Jul 17 21:18:10.524799 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.524486    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 21:18:10.618920 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.617869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9mrvr"]
Jul 17 21:18:10.620526 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.620501    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bnrph"]
Jul 17 21:18:10.620650 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.620615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.622443 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.622425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.624328 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.624312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vktg\""
Jul 17 21:18:10.624328 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.624318    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 21:18:10.624475 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.624315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 21:18:10.626019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.626002    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 21:18:10.626559 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.626429    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 21:18:10.626559 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.626537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwcbh\""
Jul 17 21:18:10.626700 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.626537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 21:18:10.633847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.633825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9mrvr"]
Jul 17 21:18:10.638518 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.638496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnrph"]
Jul 17 21:18:10.707869 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.707827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbnp4\" (UniqueName: \"kubernetes.io/projected/3ce236c0-00df-45b1-b648-20447ba8fa0e-kube-api-access-jbnp4\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.708064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.707907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce236c0-00df-45b1-b648-20447ba8fa0e-cert\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.708064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.707951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e79813f-3695-47f8-9872-63c0641b6377-metrics-tls\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.708064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.707976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e79813f-3695-47f8-9872-63c0641b6377-tmp-dir\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.708064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.707996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e79813f-3695-47f8-9872-63c0641b6377-config-volume\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.708064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.708016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzst\" (UniqueName: \"kubernetes.io/projected/1e79813f-3695-47f8-9872-63c0641b6377-kube-api-access-9wzst\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.725721 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.725690    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vqb2c"]
Jul 17 21:18:10.727876 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.727858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.730631 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.730614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 21:18:10.731249 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.731232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvj24\""
Jul 17 21:18:10.731350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.731254    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 21:18:10.732489 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.732477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 21:18:10.732639 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.732624    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 21:18:10.745537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.745510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vqb2c"]
Jul 17 21:18:10.756975 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.756950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:10.757107 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.756950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:10.757168 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.756957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:10.760592 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.760570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:18:10.760719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.760699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 21:18:10.760859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.760830    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpmh2\""
Jul 17 21:18:10.760859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.760845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 21:18:10.760859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.760836    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:18:10.761375 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.761361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzlv\""
Jul 17 21:18:10.808799 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce236c0-00df-45b1-b648-20447ba8fa0e-cert\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.808957 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e79813f-3695-47f8-9872-63c0641b6377-metrics-tls\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.808957 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e79813f-3695-47f8-9872-63c0641b6377-tmp-dir\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.808957 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e79813f-3695-47f8-9872-63c0641b6377-config-volume\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.808957 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzst\" (UniqueName: \"kubernetes.io/projected/1e79813f-3695-47f8-9872-63c0641b6377-kube-api-access-9wzst\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.808957 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.808897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbnp4\" (UniqueName: \"kubernetes.io/projected/3ce236c0-00df-45b1-b648-20447ba8fa0e-kube-api-access-jbnp4\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.809288 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.809263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e79813f-3695-47f8-9872-63c0641b6377-tmp-dir\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.809543 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.809525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e79813f-3695-47f8-9872-63c0641b6377-config-volume\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.812748 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.812727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e79813f-3695-47f8-9872-63c0641b6377-metrics-tls\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.812902 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.812886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce236c0-00df-45b1-b648-20447ba8fa0e-cert\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.848096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.848072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzst\" (UniqueName: \"kubernetes.io/projected/1e79813f-3695-47f8-9872-63c0641b6377-kube-api-access-9wzst\") pod \"dns-default-bnrph\" (UID: \"1e79813f-3695-47f8-9872-63c0641b6377\") " pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:10.848233 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.848132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbnp4\" (UniqueName: \"kubernetes.io/projected/3ce236c0-00df-45b1-b648-20447ba8fa0e-kube-api-access-jbnp4\") pod \"ingress-canary-9mrvr\" (UID: \"3ce236c0-00df-45b1-b648-20447ba8fa0e\") " pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.909263 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.909224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f84e950-d6cc-48c3-961f-b587d4470007-crio-socket\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.909425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.909277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f84e950-d6cc-48c3-961f-b587d4470007-data-volume\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.909425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.909322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzmf\" (UniqueName: \"kubernetes.io/projected/6f84e950-d6cc-48c3-961f-b587d4470007-kube-api-access-ldzmf\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.909491 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.909414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f84e950-d6cc-48c3-961f-b587d4470007-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.909491 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.909449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f84e950-d6cc-48c3-961f-b587d4470007-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:10.931238 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.931207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9mrvr"
Jul 17 21:18:10.935856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:10.935839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:11.009933 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.009864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f84e950-d6cc-48c3-961f-b587d4470007-crio-socket\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.009933 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.009932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f84e950-d6cc-48c3-961f-b587d4470007-data-volume\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.010169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.009968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzmf\" (UniqueName: \"kubernetes.io/projected/6f84e950-d6cc-48c3-961f-b587d4470007-kube-api-access-ldzmf\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.010169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.010013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f84e950-d6cc-48c3-961f-b587d4470007-crio-socket\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.010169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.010048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f84e950-d6cc-48c3-961f-b587d4470007-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.010169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.010080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f84e950-d6cc-48c3-961f-b587d4470007-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.010429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.010404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f84e950-d6cc-48c3-961f-b587d4470007-data-volume\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.011000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.010853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f84e950-d6cc-48c3-961f-b587d4470007-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.013598 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.013576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f84e950-d6cc-48c3-961f-b587d4470007-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.020475 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.020424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzmf\" (UniqueName: \"kubernetes.io/projected/6f84e950-d6cc-48c3-961f-b587d4470007-kube-api-access-ldzmf\") pod \"insights-runtime-extractor-vqb2c\" (UID: \"6f84e950-d6cc-48c3-961f-b587d4470007\") " pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.037077 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.037052    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vqb2c"
Jul 17 21:18:11.093951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.093061    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnrph"]
Jul 17 21:18:11.096723 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.096590    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9mrvr"]
Jul 17 21:18:11.099451 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:11.099231    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e79813f_3695_47f8_9872_63c0641b6377.slice/crio-f01a3d27f06ba1d73fe9e85eb4b14e806797b3e2cbba6df23d0ad8aebc0f27eb WatchSource:0}: Error finding container f01a3d27f06ba1d73fe9e85eb4b14e806797b3e2cbba6df23d0ad8aebc0f27eb: Status 404 returned error can't find the container with id f01a3d27f06ba1d73fe9e85eb4b14e806797b3e2cbba6df23d0ad8aebc0f27eb
Jul 17 21:18:11.100264 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:11.100247    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce236c0_00df_45b1_b648_20447ba8fa0e.slice/crio-35d639947fc900cbe81033aaa3f13bb65780a4055bd9388059827b982eb18191 WatchSource:0}: Error finding container 35d639947fc900cbe81033aaa3f13bb65780a4055bd9388059827b982eb18191: Status 404 returned error can't find the container with id 35d639947fc900cbe81033aaa3f13bb65780a4055bd9388059827b982eb18191
Jul 17 21:18:11.175372 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.175336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vqb2c"]
Jul 17 21:18:11.178554 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:11.178534    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f84e950_d6cc_48c3_961f_b587d4470007.slice/crio-7275f4b00737f3f49924df3a8ef3fd27025f0fc70af1317ca264cd358297847f WatchSource:0}: Error finding container 7275f4b00737f3f49924df3a8ef3fd27025f0fc70af1317ca264cd358297847f: Status 404 returned error can't find the container with id 7275f4b00737f3f49924df3a8ef3fd27025f0fc70af1317ca264cd358297847f
Jul 17 21:18:11.986076 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.986034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vqb2c" event={"ID":"6f84e950-d6cc-48c3-961f-b587d4470007","Type":"ContainerStarted","Data":"7275f4b00737f3f49924df3a8ef3fd27025f0fc70af1317ca264cd358297847f"}
Jul 17 21:18:11.988972 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.988938    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnrph" event={"ID":"1e79813f-3695-47f8-9872-63c0641b6377","Type":"ContainerStarted","Data":"f01a3d27f06ba1d73fe9e85eb4b14e806797b3e2cbba6df23d0ad8aebc0f27eb"}
Jul 17 21:18:11.991990 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:11.991958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9mrvr" event={"ID":"3ce236c0-00df-45b1-b648-20447ba8fa0e","Type":"ContainerStarted","Data":"35d639947fc900cbe81033aaa3f13bb65780a4055bd9388059827b982eb18191"}
Jul 17 21:18:13.897384 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.897351    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"]
Jul 17 21:18:13.900995 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.900968    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:13.904322 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.904126    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cqqj2\""
Jul 17 21:18:13.905179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.905145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 21:18:13.912155 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.912095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"]
Jul 17 21:18:13.936966 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.936936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90b3a87c-68db-4f78-aadb-22f9e4a2309d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-68t6t\" (UID: \"90b3a87c-68db-4f78-aadb-22f9e4a2309d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:13.999626 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:13.999589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnrph" event={"ID":"1e79813f-3695-47f8-9872-63c0641b6377","Type":"ContainerStarted","Data":"6e5aaf3ea4206fa788617a8aad604fd4c418d2f0cdb91736a620498b8f71c0e9"}
Jul 17 21:18:14.038265 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:14.038229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90b3a87c-68db-4f78-aadb-22f9e4a2309d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-68t6t\" (UID: \"90b3a87c-68db-4f78-aadb-22f9e4a2309d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:14.041385 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:14.041357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90b3a87c-68db-4f78-aadb-22f9e4a2309d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-68t6t\" (UID: \"90b3a87c-68db-4f78-aadb-22f9e4a2309d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:14.212148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:14.212063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:15.743862 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.743826    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-twcb4"]
Jul 17 21:18:15.759869 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.759827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:15.763738 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.763715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l2t6f\""
Jul 17 21:18:15.764024 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.763997    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 21:18:15.764595 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.764573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-twcb4"]
Jul 17 21:18:15.764831 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.764811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 21:18:15.853741 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.853708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ncdn\" (UniqueName: \"kubernetes.io/projected/39dceb1b-af79-4012-88df-26a9909d919f-kube-api-access-5ncdn\") pod \"downloads-5bc67dcd46-twcb4\" (UID: \"39dceb1b-af79-4012-88df-26a9909d919f\") " pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:15.921336 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.921304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k945n"
Jul 17 21:18:15.955459 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.954182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ncdn\" (UniqueName: \"kubernetes.io/projected/39dceb1b-af79-4012-88df-26a9909d919f-kube-api-access-5ncdn\") pod \"downloads-5bc67dcd46-twcb4\" (UID: \"39dceb1b-af79-4012-88df-26a9909d919f\") " pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:15.964488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:15.964448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ncdn\" (UniqueName: \"kubernetes.io/projected/39dceb1b-af79-4012-88df-26a9909d919f-kube-api-access-5ncdn\") pod \"downloads-5bc67dcd46-twcb4\" (UID: \"39dceb1b-af79-4012-88df-26a9909d919f\") " pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:16.071995 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:16.071960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:17.000119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:16.999916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"]
Jul 17 21:18:17.003962 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:17.003937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b3a87c_68db_4f78_aadb_22f9e4a2309d.slice/crio-2b98d8787fb308ad5b35d3f791f7e747cc9139e2e6581344925ec217083d9747 WatchSource:0}: Error finding container 2b98d8787fb308ad5b35d3f791f7e747cc9139e2e6581344925ec217083d9747: Status 404 returned error can't find the container with id 2b98d8787fb308ad5b35d3f791f7e747cc9139e2e6581344925ec217083d9747
Jul 17 21:18:17.009868 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.009814    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vqb2c" event={"ID":"6f84e950-d6cc-48c3-961f-b587d4470007","Type":"ContainerStarted","Data":"0f86255d57bdf0bbf2c9f8c94f0b7736cb6e0894a87112ce173f8b87fd2651b1"}
Jul 17 21:18:17.012995 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.012561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnrph" event={"ID":"1e79813f-3695-47f8-9872-63c0641b6377","Type":"ContainerStarted","Data":"dbce20a48ccf4385267895531c2a3cd28a49e2e02a494aeb838f07dcfd576006"}
Jul 17 21:18:17.012995 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.012929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:17.014093 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.014070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t" event={"ID":"90b3a87c-68db-4f78-aadb-22f9e4a2309d","Type":"ContainerStarted","Data":"2b98d8787fb308ad5b35d3f791f7e747cc9139e2e6581344925ec217083d9747"}
Jul 17 21:18:17.015433 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.015407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9mrvr" event={"ID":"3ce236c0-00df-45b1-b648-20447ba8fa0e","Type":"ContainerStarted","Data":"28fa7f9b9ff52177421a3a93e6d9f0115b414df1de660dfb4272f680f8f42b39"}
Jul 17 21:18:17.023073 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.023045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-twcb4"]
Jul 17 21:18:17.028146 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:17.028116    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dceb1b_af79_4012_88df_26a9909d919f.slice/crio-dcc65eb9f92cedba075351800ae98e1420bdb1eae7e879dcb2b854e9ebf06928 WatchSource:0}: Error finding container dcc65eb9f92cedba075351800ae98e1420bdb1eae7e879dcb2b854e9ebf06928: Status 404 returned error can't find the container with id dcc65eb9f92cedba075351800ae98e1420bdb1eae7e879dcb2b854e9ebf06928
Jul 17 21:18:17.034437 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.034394    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bnrph" podStartSLOduration=4.959231221 podStartE2EDuration="7.034377979s" totalImagesPullingTime="2.075146758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:17.034093324 +0000 UTC m=+63.815353053" watchObservedRunningTime="2026-07-17 21:18:17.034377979 +0000 UTC m=+63.815637707"
Jul 17 21:18:17.054307 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:17.054205    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9mrvr" podStartSLOduration=1.31794864 podStartE2EDuration="7.054163867s" totalImagesPullingTime="5.736215227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:17.051837519 +0000 UTC m=+63.833097249" watchObservedRunningTime="2026-07-17 21:18:17.054163867 +0000 UTC m=+63.835423595"
Jul 17 21:18:18.021534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:18.021492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-twcb4" event={"ID":"39dceb1b-af79-4012-88df-26a9909d919f","Type":"ContainerStarted","Data":"dcc65eb9f92cedba075351800ae98e1420bdb1eae7e879dcb2b854e9ebf06928"}
Jul 17 21:18:19.026610 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.026567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t" event={"ID":"90b3a87c-68db-4f78-aadb-22f9e4a2309d","Type":"ContainerStarted","Data":"1ef0ef59e92f8fb0a22ab1478c2434c3ed51386c8a45e670692837b905c0cf96"}
Jul 17 21:18:19.027137 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.027119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:19.032548 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.032519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t"
Jul 17 21:18:19.044120 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.044072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-68t6t" podStartSLOduration=4.773821507 podStartE2EDuration="6.044057722s" totalImagesPullingTime="1.270236215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:19.043215337 +0000 UTC m=+65.824475067" watchObservedRunningTime="2026-07-17 21:18:19.044057722 +0000 UTC m=+65.825317448"
Jul 17 21:18:19.381890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.381795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:19.385112 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.385076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:18:19.398138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.398109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0f64e890-db24-4c2d-bdc6-35d0dac52b57-original-pull-secret\") pod \"global-pull-secret-syncer-5vmtj\" (UID: \"0f64e890-db24-4c2d-bdc6-35d0dac52b57\") " pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:19.466904 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.466859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vmtj"
Jul 17 21:18:19.482197 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.482164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:19.482405 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.482230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:19.485157 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.484965    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 21:18:19.485856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.485834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:18:19.495723 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.495687    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 21:18:19.496099 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.496038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a150c5d0-edb0-4e35-86e6-24ecfbcf3582-metrics-certs\") pod \"network-metrics-daemon-st68l\" (UID: \"a150c5d0-edb0-4e35-86e6-24ecfbcf3582\") " pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:19.506155 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.506127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6th\" (UniqueName: \"kubernetes.io/projected/c3e4a5a6-e921-4932-8a4e-151117c95c12-kube-api-access-cp6th\") pod \"network-check-target-22qnq\" (UID: \"c3e4a5a6-e921-4932-8a4e-151117c95c12\") " pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:19.774640 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.774603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpmh2\""
Jul 17 21:18:19.778955 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.778916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzlv\""
Jul 17 21:18:19.782827 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.782801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:19.787217 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.787185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-st68l"
Jul 17 21:18:19.961614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.961578    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"]
Jul 17 21:18:19.970991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.970964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:19.973998 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.973960    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 17 21:18:19.974149 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.974016    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 17 21:18:19.974149 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.973960    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 21:18:19.974149 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.974055    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 21:18:19.975007 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.974990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xr6tj\""
Jul 17 21:18:19.975121 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.975110    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 21:18:19.977797 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:19.977754    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"]
Jul 17 21:18:20.087278 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.087192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.087278 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.087248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/587344b6-5d4c-4120-beb6-882b280be642-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.087800 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.087281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.087800 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.087311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx5n7\" (UniqueName: \"kubernetes.io/projected/587344b6-5d4c-4120-beb6-882b280be642-kube-api-access-dx5n7\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.189130 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.189079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.189130 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.189138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/587344b6-5d4c-4120-beb6-882b280be642-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.189351 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.189171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.189351 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.189192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx5n7\" (UniqueName: \"kubernetes.io/projected/587344b6-5d4c-4120-beb6-882b280be642-kube-api-access-dx5n7\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.190056 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:20.190034    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 17 21:18:20.190173 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:20.190153    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls podName:587344b6-5d4c-4120-beb6-882b280be642 nodeName:}" failed. No retries permitted until 2026-07-17 21:18:20.690132308 +0000 UTC m=+67.471392013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-6t28j" (UID: "587344b6-5d4c-4120-beb6-882b280be642") : secret "prometheus-operator-tls" not found
Jul 17 21:18:20.190806 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.190759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/587344b6-5d4c-4120-beb6-882b280be642-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.192428 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.192402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.201331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.201296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx5n7\" (UniqueName: \"kubernetes.io/projected/587344b6-5d4c-4120-beb6-882b280be642-kube-api-access-dx5n7\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.692464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.692428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.695655 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.695625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/587344b6-5d4c-4120-beb6-882b280be642-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6t28j\" (UID: \"587344b6-5d4c-4120-beb6-882b280be642\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:20.883129 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:20.882901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"
Jul 17 21:18:21.021206 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.020695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-st68l"]
Jul 17 21:18:21.042842 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.042800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vqb2c" event={"ID":"6f84e950-d6cc-48c3-961f-b587d4470007","Type":"ContainerStarted","Data":"e40b04e34845f8a9d7673c39e76ec139073ac96c321f5fe1207f98056ea1a655"}
Jul 17 21:18:21.044988 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.044945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22qnq"]
Jul 17 21:18:21.046019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.045991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-st68l" event={"ID":"a150c5d0-edb0-4e35-86e6-24ecfbcf3582","Type":"ContainerStarted","Data":"892212a065370ab91b799e49189760a0cc4e6e84dac944feed2cee15eb8beb68"}
Jul 17 21:18:21.114182 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.114151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6t28j"]
Jul 17 21:18:21.118190 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:21.118161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587344b6_5d4c_4120_beb6_882b280be642.slice/crio-716b976cef9d937ff112f1ee778cc5b5e4fd05419f3a3e1c0fc7004ee1e30d4f WatchSource:0}: Error finding container 716b976cef9d937ff112f1ee778cc5b5e4fd05419f3a3e1c0fc7004ee1e30d4f: Status 404 returned error can't find the container with id 716b976cef9d937ff112f1ee778cc5b5e4fd05419f3a3e1c0fc7004ee1e30d4f
Jul 17 21:18:21.255460 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:21.255383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vmtj"]
Jul 17 21:18:21.258527 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:21.258502    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f64e890_db24_4c2d_bdc6_35d0dac52b57.slice/crio-5b48b87208c980050f20b26083d9a1124f93d842fcc265539235e16c0258f9f0 WatchSource:0}: Error finding container 5b48b87208c980050f20b26083d9a1124f93d842fcc265539235e16c0258f9f0: Status 404 returned error can't find the container with id 5b48b87208c980050f20b26083d9a1124f93d842fcc265539235e16c0258f9f0
Jul 17 21:18:22.052704 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:22.052646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j" event={"ID":"587344b6-5d4c-4120-beb6-882b280be642","Type":"ContainerStarted","Data":"716b976cef9d937ff112f1ee778cc5b5e4fd05419f3a3e1c0fc7004ee1e30d4f"}
Jul 17 21:18:22.056482 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:22.056420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22qnq" event={"ID":"c3e4a5a6-e921-4932-8a4e-151117c95c12","Type":"ContainerStarted","Data":"343020752cbf12cd6fd814d1455692f353ab10f7613cff36cca73de087e45edf"}
Jul 17 21:18:22.058941 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:22.058890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vmtj" event={"ID":"0f64e890-db24-4c2d-bdc6-35d0dac52b57","Type":"ContainerStarted","Data":"5b48b87208c980050f20b26083d9a1124f93d842fcc265539235e16c0258f9f0"}
Jul 17 21:18:24.025437 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.025403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bnrph"
Jul 17 21:18:24.084890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.084550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j" event={"ID":"587344b6-5d4c-4120-beb6-882b280be642","Type":"ContainerStarted","Data":"bcee28af88286b370d86de36c6c85145fbf934889098cc3689745fb69e2f5717"}
Jul 17 21:18:24.084890 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.084651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j" event={"ID":"587344b6-5d4c-4120-beb6-882b280be642","Type":"ContainerStarted","Data":"ade9d9c5bdda6e4077a9c6af415df66cbed2dd375b723155fe7981e9cc4a493d"}
Jul 17 21:18:24.090031 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.089980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-st68l" event={"ID":"a150c5d0-edb0-4e35-86e6-24ecfbcf3582","Type":"ContainerStarted","Data":"4b3b98aa577f42401c6d64f60be3e60be8f48316190a31804273ab1ea4082484"}
Jul 17 21:18:24.090306 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.090047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-st68l" event={"ID":"a150c5d0-edb0-4e35-86e6-24ecfbcf3582","Type":"ContainerStarted","Data":"5ea56dec717177ba49c914c84bec71f0eb93677509c31c4f118bb66751dcc715"}
Jul 17 21:18:24.129276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.128789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-st68l" podStartSLOduration=67.608291176 podStartE2EDuration="1m10.12875079s" totalImagesPullingTime="2.520459614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:24.127915282 +0000 UTC m=+70.909175011" watchObservedRunningTime="2026-07-17 21:18:24.12875079 +0000 UTC m=+70.910010518"
Jul 17 21:18:24.129276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:24.128939    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6t28j" podStartSLOduration=2.695470386 podStartE2EDuration="5.128929444s" totalImagesPullingTime="2.433459058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:24.106093228 +0000 UTC m=+70.887352961" watchObservedRunningTime="2026-07-17 21:18:24.128929444 +0000 UTC m=+70.910189173"
Jul 17 21:18:25.254098 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.254061    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:18:25.256746 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.256721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261247    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261305    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pxj2w\""
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261463    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261518    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 21:18:25.261954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.261750    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 21:18:25.268635 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.268614    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:18:25.329538 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.329726 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.329726 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.329726 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.329726 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.329942 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.329796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntwzv\" (UniqueName: \"kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.430846 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.431021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.431021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.431021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.431021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntwzv\" (UniqueName: \"kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.431021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.430992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.432503 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.432092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.432503 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.432418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.432503 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.432474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.434083 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.434057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.434663 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.434638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.441333 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.441313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntwzv\" (UniqueName: \"kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv\") pod \"console-947448f6b-gkfmr\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") " pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:25.568717 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:25.568676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:26.339462 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.339433    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"]
Jul 17 21:18:26.344315 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.344288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.348001 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.347970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 21:18:26.348001 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.347985    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jd2l5\""
Jul 17 21:18:26.348188 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.348108    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 21:18:26.354375 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.354300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"]
Jul 17 21:18:26.371621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.371591    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"]
Jul 17 21:18:26.374707 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.374687    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9phgt"]
Jul 17 21:18:26.374870 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.374851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.377622 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.377597    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 21:18:26.377723 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.377685    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxq7h\""
Jul 17 21:18:26.377814 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.377752    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 21:18:26.377814 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.377808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.378071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.377986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 21:18:26.380388 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.380366    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 21:18:26.381367 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.381158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p8ktt\""
Jul 17 21:18:26.381796 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.381693    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 21:18:26.382269 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.382093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 21:18:26.395679 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.395651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"]
Jul 17 21:18:26.438877 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m7lr\" (UniqueName: \"kubernetes.io/projected/4e2fd377-e2f7-495e-9f42-2a43b38ef537-kube-api-access-9m7lr\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-textfile\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjpb\" (UniqueName: \"kubernetes.io/projected/c14d48b3-0ba4-43c6-a861-e04762a068d4-kube-api-access-4cjpb\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.439044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.438995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-root\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-wtmp\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-tls\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-sys\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-metrics-client-ca\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.439711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14d48b3-0ba4-43c6-a861-e04762a068d4-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.439711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrw6\" (UniqueName: \"kubernetes.io/projected/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-api-access-zhrw6\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.439711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.439481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m7lr\" (UniqueName: \"kubernetes.io/projected/4e2fd377-e2f7-495e-9f42-2a43b38ef537-kube-api-access-9m7lr\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-textfile\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjpb\" (UniqueName: \"kubernetes.io/projected/c14d48b3-0ba4-43c6-a861-e04762a068d4-kube-api-access-4cjpb\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-root\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.540984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-wtmp\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-tls\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-sys\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-metrics-client-ca\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.541713 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14d48b3-0ba4-43c6-a861-e04762a068d4-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.542825 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.542825 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrw6\" (UniqueName: \"kubernetes.io/projected/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-api-access-zhrw6\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.542825 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.542825 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-textfile\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.542825 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.542476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.543118 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.542856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-root\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.543199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-sys\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14d48b3-0ba4-43c6-a861-e04762a068d4-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:26.544414    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:26.544469    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls podName:a1c8b25a-a008-4a40-ac34-b73c2a303d8d nodeName:}" failed. No retries permitted until 2026-07-17 21:18:27.044451698 +0000 UTC m=+73.825711404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-dqn8t" (UID: "a1c8b25a-a008-4a40-ac34-b73c2a303d8d") : secret "kube-state-metrics-tls" not found
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-metrics-client-ca\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.541297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-wtmp\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.544903 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.544848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.545597 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.545112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.546836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.546810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fd377-e2f7-495e-9f42-2a43b38ef537-node-exporter-tls\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.547453 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.547401    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14d48b3-0ba4-43c6-a861-e04762a068d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.548195 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.548141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.550584 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.550564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m7lr\" (UniqueName: \"kubernetes.io/projected/4e2fd377-e2f7-495e-9f42-2a43b38ef537-kube-api-access-9m7lr\") pod \"node-exporter-9phgt\" (UID: \"4e2fd377-e2f7-495e-9f42-2a43b38ef537\") " pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:26.552747 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.552722    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjpb\" (UniqueName: \"kubernetes.io/projected/c14d48b3-0ba4-43c6-a861-e04762a068d4-kube-api-access-4cjpb\") pod \"openshift-state-metrics-79f6958cdf-2cghq\" (UID: \"c14d48b3-0ba4-43c6-a861-e04762a068d4\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.555693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.555673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrw6\" (UniqueName: \"kubernetes.io/projected/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-api-access-zhrw6\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:26.658144 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.657750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"
Jul 17 21:18:26.694529 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:26.694490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9phgt"
Jul 17 21:18:27.045920 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.045878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:27.049160 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.049101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1c8b25a-a008-4a40-ac34-b73c2a303d8d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-dqn8t\" (UID: \"a1c8b25a-a008-4a40-ac34-b73c2a303d8d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:27.287163 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.287125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"
Jul 17 21:18:27.437149 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.436942    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:18:27.442399 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.442371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.449684 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.449602    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59znh\""
Jul 17 21:18:27.450178 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.450158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 21:18:27.450569 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.450546    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 21:18:27.450912 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.450870    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 21:18:27.451111 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.451095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 21:18:27.451472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.451453    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 21:18:27.451678 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.451663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 21:18:27.452099 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.451943    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 21:18:27.452236 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.452217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 21:18:27.466939 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.466908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:18:27.468645 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.468621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.552807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97s8t\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.552942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.553299 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.553007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.653838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.653982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s8t\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.654341 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.654157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.655394 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.655352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.656601 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.655688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.656601 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.655978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.659330 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.658828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.659330 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.659048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.659330 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.659290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.659513 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.659346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.660238 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.660212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.660400 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.660302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.660813 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.660753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.661269 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.661249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.666428 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.666409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97s8t\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.667512 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.667489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config\") pod \"alertmanager-main-0\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:27.755106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:27.755022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:18:29.133311 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.133175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phgt" event={"ID":"4e2fd377-e2f7-495e-9f42-2a43b38ef537","Type":"ContainerStarted","Data":"4e07e0d267a6a88ddaa1c953179baa173ca28ab38e188051912fad8cc36a619d"}
Jul 17 21:18:29.305937 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.305856    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq"]
Jul 17 21:18:29.310275 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:29.310229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14d48b3_0ba4_43c6_a861_e04762a068d4.slice/crio-18bb9b2e20a86661a04738487f03edb29108caa6558d807e4467a4fc9a1556b5 WatchSource:0}: Error finding container 18bb9b2e20a86661a04738487f03edb29108caa6558d807e4467a4fc9a1556b5: Status 404 returned error can't find the container with id 18bb9b2e20a86661a04738487f03edb29108caa6558d807e4467a4fc9a1556b5
Jul 17 21:18:29.393656 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.393630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:18:29.396257 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:29.396228    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbb36c9_3510_40cf_8423_25ec98a74359.slice/crio-7a9c2e1b5c2871b49e9951b822a35ec72a9a083c20f59e18d4e26a0f02d25152 WatchSource:0}: Error finding container 7a9c2e1b5c2871b49e9951b822a35ec72a9a083c20f59e18d4e26a0f02d25152: Status 404 returned error can't find the container with id 7a9c2e1b5c2871b49e9951b822a35ec72a9a083c20f59e18d4e26a0f02d25152
Jul 17 21:18:29.482471 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.482431    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"]
Jul 17 21:18:29.486361 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.486339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.497033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.495522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 21:18:29.497033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.495837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2uehn484iltr4\""
Jul 17 21:18:29.497033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.496080    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 21:18:29.497033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.496322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 21:18:29.497033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.496318    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 21:18:29.497454 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.497060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zjnzc\""
Jul 17 21:18:29.497454 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.497330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 21:18:29.508397 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.508292    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"]
Jul 17 21:18:29.535853 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.535601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:18:29.538355 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:29.538314    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd098e9ab_0d4e_4190_89dd_8db0672f957c.slice/crio-12a997228c8f2bd5a80a4360196e8894c48122543bca7183f285554f8c9d90cc WatchSource:0}: Error finding container 12a997228c8f2bd5a80a4360196e8894c48122543bca7183f285554f8c9d90cc: Status 404 returned error can't find the container with id 12a997228c8f2bd5a80a4360196e8894c48122543bca7183f285554f8c9d90cc
Jul 17 21:18:29.543172 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.543089    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-dqn8t"]
Jul 17 21:18:29.548468 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:29.548444    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c8b25a_a008_4a40_ac34_b73c2a303d8d.slice/crio-c0036132f42530a717bcd647366c39aea2abb8731980bc72421ff5199889e2cc WatchSource:0}: Error finding container c0036132f42530a717bcd647366c39aea2abb8731980bc72421ff5199889e2cc: Status 404 returned error can't find the container with id c0036132f42530a717bcd647366c39aea2abb8731980bc72421ff5199889e2cc
Jul 17 21:18:29.573245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b7a23-915d-4786-9c78-c26f39a23f34-metrics-client-ca\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-grpc-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9xx\" (UniqueName: \"kubernetes.io/projected/0c8b7a23-915d-4786-9c78-c26f39a23f34-kube-api-access-gh9xx\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.573567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.573441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9xx\" (UniqueName: \"kubernetes.io/projected/0c8b7a23-915d-4786-9c78-c26f39a23f34-kube-api-access-gh9xx\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b7a23-915d-4786-9c78-c26f39a23f34-metrics-client-ca\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-grpc-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.675425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.674953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.677003 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.676921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b7a23-915d-4786-9c78-c26f39a23f34-metrics-client-ca\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.678439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.678392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.679077 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.679016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.679077 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.679062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.679718 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.679697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-grpc-tls\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.679994 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.679973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.681390 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.681367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c8b7a23-915d-4786-9c78-c26f39a23f34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.687335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.687315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9xx\" (UniqueName: \"kubernetes.io/projected/0c8b7a23-915d-4786-9c78-c26f39a23f34-kube-api-access-gh9xx\") pod \"thanos-querier-7dd96c9474-wsvzj\" (UID: \"0c8b7a23-915d-4786-9c78-c26f39a23f34\") " pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.802527 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.802159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:29.984421 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:29.984318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"]
Jul 17 21:18:30.121732 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:30.121642    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8b7a23_915d_4786_9c78_c26f39a23f34.slice/crio-d21339cf2213506f9079f1ec4d6cc5ff1f79142da13e5ee8d4cfc4eba26e3bbb WatchSource:0}: Error finding container d21339cf2213506f9079f1ec4d6cc5ff1f79142da13e5ee8d4cfc4eba26e3bbb: Status 404 returned error can't find the container with id d21339cf2213506f9079f1ec4d6cc5ff1f79142da13e5ee8d4cfc4eba26e3bbb
Jul 17 21:18:30.141063 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.140971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vqb2c" event={"ID":"6f84e950-d6cc-48c3-961f-b587d4470007","Type":"ContainerStarted","Data":"557385ac34d8b55ac57060f18730d8aff60c68e5754c278143d8a1301e7c41d2"}
Jul 17 21:18:30.143160 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.143127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"d21339cf2213506f9079f1ec4d6cc5ff1f79142da13e5ee8d4cfc4eba26e3bbb"}
Jul 17 21:18:30.144651 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.144622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"7a9c2e1b5c2871b49e9951b822a35ec72a9a083c20f59e18d4e26a0f02d25152"}
Jul 17 21:18:30.147122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.147095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq" event={"ID":"c14d48b3-0ba4-43c6-a861-e04762a068d4","Type":"ContainerStarted","Data":"192174d67575f41768162c9514f22eb567dd26463796f3e9dc1fe185f719a82c"}
Jul 17 21:18:30.147245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.147145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq" event={"ID":"c14d48b3-0ba4-43c6-a861-e04762a068d4","Type":"ContainerStarted","Data":"4d5c639360ebafc6c0d8a3f9417df65230ca66da5cc2c586a90a8dcf4091d49d"}
Jul 17 21:18:30.147245 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.147163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq" event={"ID":"c14d48b3-0ba4-43c6-a861-e04762a068d4","Type":"ContainerStarted","Data":"18bb9b2e20a86661a04738487f03edb29108caa6558d807e4467a4fc9a1556b5"}
Jul 17 21:18:30.149089 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.149066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22qnq" event={"ID":"c3e4a5a6-e921-4932-8a4e-151117c95c12","Type":"ContainerStarted","Data":"7e2fd879a502a7d6f2a88698f00e93cb02e5ee606e242da6a274545983e2bb89"}
Jul 17 21:18:30.149580 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.149562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:18:30.151583 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.151559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t" event={"ID":"a1c8b25a-a008-4a40-ac34-b73c2a303d8d","Type":"ContainerStarted","Data":"c0036132f42530a717bcd647366c39aea2abb8731980bc72421ff5199889e2cc"}
Jul 17 21:18:30.153029 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.152983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-947448f6b-gkfmr" event={"ID":"d098e9ab-0d4e-4190-89dd-8db0672f957c","Type":"ContainerStarted","Data":"12a997228c8f2bd5a80a4360196e8894c48122543bca7183f285554f8c9d90cc"}
Jul 17 21:18:30.155505 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.154978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vmtj" event={"ID":"0f64e890-db24-4c2d-bdc6-35d0dac52b57","Type":"ContainerStarted","Data":"4cb9559418cf1fb1a1423a8f74802a15ee89a7aa4191cda64cf10a4ac470dc7b"}
Jul 17 21:18:30.180734 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.180676    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vqb2c" podStartSLOduration=2.482087333 podStartE2EDuration="20.180654483s" totalImagesPullingTime="17.69856715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:18:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:30.179075795 +0000 UTC m=+76.960335525" watchObservedRunningTime="2026-07-17 21:18:30.180654483 +0000 UTC m=+76.961914212"
Jul 17 21:18:30.218119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.218059    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5vmtj" podStartSLOduration=68.37730843 podStartE2EDuration="1m16.218037221s" totalImagesPullingTime="7.840728791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:30.216934468 +0000 UTC m=+76.998194196" watchObservedRunningTime="2026-07-17 21:18:30.218037221 +0000 UTC m=+76.999296948"
Jul 17 21:18:30.256722 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.255928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-22qnq" podStartSLOduration=68.215963145 podStartE2EDuration="1m16.255909073s" totalImagesPullingTime="8.039945928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:30.255478927 +0000 UTC m=+77.036738655" watchObservedRunningTime="2026-07-17 21:18:30.255909073 +0000 UTC m=+77.037168800"
Jul 17 21:18:30.776285 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.776245    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9bd46598f-2gv7r"]
Jul 17 21:18:30.780568 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.780038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.784629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.784413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 21:18:30.784629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.784413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8esp3oqf4q4vu\""
Jul 17 21:18:30.785792 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.785308    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 21:18:30.785792 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.785432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 21:18:30.785792 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.785566    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zsgdh\""
Jul 17 21:18:30.785792 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.785565    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 21:18:30.795889 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.795825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9bd46598f-2gv7r"]
Jul 17 21:18:30.886147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2gwf\" (UniqueName: \"kubernetes.io/projected/8fb59115-9acd-445e-896b-3309734bb12c-kube-api-access-w2gwf\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8fb59115-9acd-445e-896b-3309734bb12c-audit-log\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-metrics-server-audit-profiles\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-tls\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-client-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-client-certs\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.886439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.886404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.987675 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8fb59115-9acd-445e-896b-3309734bb12c-audit-log\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.987888 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-metrics-server-audit-profiles\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.987888 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-tls\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.987888 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-client-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.987888 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-client-certs\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.988034 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.987923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.988067 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.988031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2gwf\" (UniqueName: \"kubernetes.io/projected/8fb59115-9acd-445e-896b-3309734bb12c-kube-api-access-w2gwf\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.988164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.988142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8fb59115-9acd-445e-896b-3309734bb12c-audit-log\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.988870 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.988843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-metrics-server-audit-profiles\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.988997 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.988971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb59115-9acd-445e-896b-3309734bb12c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.991103 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.991078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-client-certs\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.991212 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.991145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-client-ca-bundle\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.991360 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.991335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8fb59115-9acd-445e-896b-3309734bb12c-secret-metrics-server-tls\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:30.998168 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:30.998119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2gwf\" (UniqueName: \"kubernetes.io/projected/8fb59115-9acd-445e-896b-3309734bb12c-kube-api-access-w2gwf\") pod \"metrics-server-9bd46598f-2gv7r\" (UID: \"8fb59115-9acd-445e-896b-3309734bb12c\") " pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:31.095114 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.095028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:31.147262 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.147223    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"]
Jul 17 21:18:31.160742 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.160699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.166873 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.166835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dvmrq\""
Jul 17 21:18:31.167110 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.167081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 17 21:18:31.169108 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.169041    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"]
Jul 17 21:18:31.170987 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.170958    2579 generic.go:356] "Generic (PLEG): container finished" podID="4e2fd377-e2f7-495e-9f42-2a43b38ef537" containerID="8844c88337b926b7cd1a98cc330649848c6c03b41aa143070c2eeb808f0a58b8" exitCode=0
Jul 17 21:18:31.171961 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.171926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phgt" event={"ID":"4e2fd377-e2f7-495e-9f42-2a43b38ef537","Type":"ContainerDied","Data":"8844c88337b926b7cd1a98cc330649848c6c03b41aa143070c2eeb808f0a58b8"}
Jul 17 21:18:31.190389 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.190353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgwx\" (UniqueName: \"kubernetes.io/projected/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-kube-api-access-gxgwx\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.190537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.190514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.292732 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.291048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgwx\" (UniqueName: \"kubernetes.io/projected/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-kube-api-access-gxgwx\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.292732 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.291317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.294600 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.294551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.305895 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.305864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgwx\" (UniqueName: \"kubernetes.io/projected/1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0-kube-api-access-gxgwx\") pod \"monitoring-plugin-7b7b7bc8bf-zxsvq\" (UID: \"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:31.479073 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:31.478985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:32.691868 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.691826    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:18:32.698679 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.698648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.703058 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.702667    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 21:18:32.703058 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.703015    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.704491    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.704579    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rl93qob9s1bu\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.704732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8zcw\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.704842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705201    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705492    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.705916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 21:18:32.706629 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.706361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 21:18:32.707492 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.706960    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 21:18:32.717923 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.717895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:18:32.807059 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnr9h\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807578 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.807973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.807703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908473 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908648 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.908854 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.908654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnr9h\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909122 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909490 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909490 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909490 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909490 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.909677 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.909600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.911106 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:18:32.909898    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle podName:0ba28c2e-f039-4872-b799-f16cc9619daf nodeName:}" failed. No retries permitted until 2026-07-17 21:18:33.409877835 +0000 UTC m=+80.191137554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf") : configmap references non-existent config key: ca-bundle.crt
Jul 17 21:18:32.911106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.910056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.911106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.910331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.911106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.910674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.911106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.910946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.912316 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.912207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.915562 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.915540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.916329 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.916302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.918094 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.918060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920163 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920163 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920275 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920192    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920275 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920557 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920530    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920638 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.920698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.921019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.920994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.921647 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.921623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:32.938710 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:32.938682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnr9h\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:33.414631 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:33.414585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:33.415988 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:33.415963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:33.618283 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:33.618237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:18:40.825465 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:40.825430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9bd46598f-2gv7r"]
Jul 17 21:18:40.838029 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:40.837996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:18:40.843986 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:40.843892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"]
Jul 17 21:18:41.107307 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:41.107269    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb59115_9acd_445e_896b_3309734bb12c.slice/crio-13ce05db365f2b76faa25290975ead4adde9be2f491a31c83427b6c9fcb61ec8 WatchSource:0}: Error finding container 13ce05db365f2b76faa25290975ead4adde9be2f491a31c83427b6c9fcb61ec8: Status 404 returned error can't find the container with id 13ce05db365f2b76faa25290975ead4adde9be2f491a31c83427b6c9fcb61ec8
Jul 17 21:18:41.108055 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:41.108026    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba28c2e_f039_4872_b799_f16cc9619daf.slice/crio-0b1373b191efc77b0cecee7c95237b358d74e716dc8857b83e2a41e61d018f4e WatchSource:0}: Error finding container 0b1373b191efc77b0cecee7c95237b358d74e716dc8857b83e2a41e61d018f4e: Status 404 returned error can't find the container with id 0b1373b191efc77b0cecee7c95237b358d74e716dc8857b83e2a41e61d018f4e
Jul 17 21:18:41.108958 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:18:41.108885    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2d3546_0c68_4ddc_ba2d_fb671b6afdd0.slice/crio-d8b0a906291464959e49826cbfed9948c730999269692545b7cd7bede94573dd WatchSource:0}: Error finding container d8b0a906291464959e49826cbfed9948c730999269692545b7cd7bede94573dd: Status 404 returned error can't find the container with id d8b0a906291464959e49826cbfed9948c730999269692545b7cd7bede94573dd
Jul 17 21:18:41.214381 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:41.214340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r" event={"ID":"8fb59115-9acd-445e-896b-3309734bb12c","Type":"ContainerStarted","Data":"13ce05db365f2b76faa25290975ead4adde9be2f491a31c83427b6c9fcb61ec8"}
Jul 17 21:18:41.215730 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:41.215702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"0b1373b191efc77b0cecee7c95237b358d74e716dc8857b83e2a41e61d018f4e"}
Jul 17 21:18:41.217082 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:41.217055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq" event={"ID":"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0","Type":"ContainerStarted","Data":"d8b0a906291464959e49826cbfed9948c730999269692545b7cd7bede94573dd"}
Jul 17 21:18:42.249538 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.248739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq" event={"ID":"c14d48b3-0ba4-43c6-a861-e04762a068d4","Type":"ContainerStarted","Data":"6ed8ff6bab30244bb39ebba5796f8ffa30fa11b871d02f9b34d408e3ff2a3e1e"}
Jul 17 21:18:42.261481 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.259787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-twcb4" event={"ID":"39dceb1b-af79-4012-88df-26a9909d919f","Type":"ContainerStarted","Data":"f4762d356a232783248416f7819da34b16c69f7c06acf78fb7ba71fd8317d00c"}
Jul 17 21:18:42.275803 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.272907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phgt" event={"ID":"4e2fd377-e2f7-495e-9f42-2a43b38ef537","Type":"ContainerStarted","Data":"6b6d6be2d71e123f5a768214360d8982fe60f1e0bb00c46621a4421523e4f11a"}
Jul 17 21:18:42.280091 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.279082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-947448f6b-gkfmr" event={"ID":"d098e9ab-0d4e-4190-89dd-8db0672f957c","Type":"ContainerStarted","Data":"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"}
Jul 17 21:18:42.288489 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.287556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:42.288876 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.288643    2579 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-twcb4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body=
Jul 17 21:18:42.288876 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.288698    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-twcb4" podUID="39dceb1b-af79-4012-88df-26a9909d919f" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused"
Jul 17 21:18:42.390473 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.390303    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-947448f6b-gkfmr" podStartSLOduration=6.294968556 podStartE2EDuration="17.390268616s" totalImagesPullingTime="11.09530006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:42.388555363 +0000 UTC m=+89.169815092" watchObservedRunningTime="2026-07-17 21:18:42.390268616 +0000 UTC m=+89.171528425"
Jul 17 21:18:42.392464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.392299    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2cghq" podStartSLOduration=5.230329371 podStartE2EDuration="16.392283102s" totalImagesPullingTime="11.161953731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:42.318471114 +0000 UTC m=+89.099730843" watchObservedRunningTime="2026-07-17 21:18:42.392283102 +0000 UTC m=+89.173542831"
Jul 17 21:18:42.430711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:42.430304    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-twcb4" podStartSLOduration=3.8283679470000003 podStartE2EDuration="27.430280549s" totalImagesPullingTime="23.601912602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:42.429696323 +0000 UTC m=+89.210956050" watchObservedRunningTime="2026-07-17 21:18:42.430280549 +0000 UTC m=+89.211540275"
Jul 17 21:18:43.291565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.291333    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a" exitCode=0
Jul 17 21:18:43.291565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.291467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a"}
Jul 17 21:18:43.295443 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.295395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phgt" event={"ID":"4e2fd377-e2f7-495e-9f42-2a43b38ef537","Type":"ContainerStarted","Data":"6ecf074bd6b7ad08feee0e954913704d7621e81d2785259b82dccf7f658277f2"}
Jul 17 21:18:43.297827 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.297794    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07" exitCode=0
Jul 17 21:18:43.297930 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.297897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"}
Jul 17 21:18:43.304100 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.304068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"53c048d1aac644f0123034dc54cf6a1f2116f7f4542fbf38b1be31542e83bfa0"}
Jul 17 21:18:43.304295 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.304274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"386aa7b409be8e83c17fc3378e8c436314d0828281b86c26a5b5315c6b6becb9"}
Jul 17 21:18:43.304450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.304431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"ed285478912c9b694334719c1f34fcbbb1ab4762e4f6bb86bb2a8f9e701d7a32"}
Jul 17 21:18:43.307859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.307796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t" event={"ID":"a1c8b25a-a008-4a40-ac34-b73c2a303d8d","Type":"ContainerStarted","Data":"eb2af417c5f889c76ce931860e33aff2e5f1a4c9de1dd033af20240e8c29881d"}
Jul 17 21:18:43.307951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.307867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t" event={"ID":"a1c8b25a-a008-4a40-ac34-b73c2a303d8d","Type":"ContainerStarted","Data":"6b1712c0320692db87286827831a6062ed09d41359c36b60f1f77da5b194b862"}
Jul 17 21:18:43.307951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.307898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t" event={"ID":"a1c8b25a-a008-4a40-ac34-b73c2a303d8d","Type":"ContainerStarted","Data":"75ba2b6908735600c536266391992811d4b9d50b7a888670003a52061acbff92"}
Jul 17 21:18:43.321377 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.321346    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-twcb4"
Jul 17 21:18:43.383606 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.383541    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-dqn8t" podStartSLOduration=4.8845117160000004 podStartE2EDuration="17.383524609s" totalImagesPullingTime="12.499012893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:43.383300084 +0000 UTC m=+90.164559828" watchObservedRunningTime="2026-07-17 21:18:43.383524609 +0000 UTC m=+90.164784335"
Jul 17 21:18:43.517998 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:43.517361    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9phgt" podStartSLOduration=16.355708415 podStartE2EDuration="17.517333607s" totalImagesPullingTime="1.070367313s" totalInitContainerRuntime="91.257879ms" isStatefulPod=true podCreationTimestamp="2026-07-17 21:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:43.515835814 +0000 UTC m=+90.297095542" watchObservedRunningTime="2026-07-17 21:18:43.517333607 +0000 UTC m=+90.298593335"
Jul 17 21:18:45.064727 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.062502    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:18:45.321901 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.321812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq" event={"ID":"1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0","Type":"ContainerStarted","Data":"a0819ab315d93cfe19ea6a7e05999eab80534cea45bf1ed0e0289b18f2be33e3"}
Jul 17 21:18:45.325574 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.325541    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:45.330999 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.330967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r" event={"ID":"8fb59115-9acd-445e-896b-3309734bb12c","Type":"ContainerStarted","Data":"8ae756697f2b066cdd6a23f8f5d78c9d49871980a53f531d54d89e4547888f3e"}
Jul 17 21:18:45.332824 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.332786    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq"
Jul 17 21:18:45.358954 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.358034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zxsvq" podStartSLOduration=10.911255702 podStartE2EDuration="14.358014004s" totalImagesPullingTime="3.446758302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:45.357440268 +0000 UTC m=+92.138699998" watchObservedRunningTime="2026-07-17 21:18:45.358014004 +0000 UTC m=+92.139273734"
Jul 17 21:18:45.389856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.389798    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r" podStartSLOduration=11.935787793 podStartE2EDuration="15.389776291s" totalImagesPullingTime="3.453988498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:45.389284074 +0000 UTC m=+92.170543801" watchObservedRunningTime="2026-07-17 21:18:45.389776291 +0000 UTC m=+92.171036010"
Jul 17 21:18:45.569427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:45.569348    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:18:47.345179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:47.345138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"}
Jul 17 21:18:47.349227 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:47.349189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"39454d2beab9724bc96040c92fc9d1055b54c07c87dedab7042e96f8de90941d"}
Jul 17 21:18:47.349356 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:47.349282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"84b3b9161ecd04d58a507008670d95392138050f1d256dbe3a68ded943063260"}
Jul 17 21:18:47.349356 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:47.349333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" event={"ID":"0c8b7a23-915d-4786-9c78-c26f39a23f34","Type":"ContainerStarted","Data":"ecab0a49245a3b00949c3b99f2f8627a76e15f0d79dad92421c3ad2d43d7cc34"}
Jul 17 21:18:48.359081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:48.358959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"}
Jul 17 21:18:48.360650 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:48.359815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"}
Jul 17 21:18:48.360650 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:48.359890    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:48.366718 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:48.366692    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj"
Jul 17 21:18:48.394981 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:48.394912    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dd96c9474-wsvzj" podStartSLOduration=3.404430878 podStartE2EDuration="19.394889668s" totalImagesPullingTime="15.99045879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:48.39337358 +0000 UTC m=+95.174633312" watchObservedRunningTime="2026-07-17 21:18:48.394889668 +0000 UTC m=+95.176149397"
Jul 17 21:18:49.368523 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:49.368488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"}
Jul 17 21:18:49.368892 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:49.368585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"}
Jul 17 21:18:49.368892 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:49.368627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerStarted","Data":"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"}
Jul 17 21:18:50.378355 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"}
Jul 17 21:18:50.378847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"}
Jul 17 21:18:50.378847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"}
Jul 17 21:18:50.378847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"}
Jul 17 21:18:50.378847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"}
Jul 17 21:18:50.378847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.378505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerStarted","Data":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"}
Jul 17 21:18:50.414746 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.414679    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.383957762 podStartE2EDuration="23.414656709s" totalImagesPullingTime="14.981579775s" totalInitContainerRuntime="49.119172ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:50.412319761 +0000 UTC m=+97.193579511" watchObservedRunningTime="2026-07-17 21:18:50.414656709 +0000 UTC m=+97.195916441"
Jul 17 21:18:50.462933 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:50.462863    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.490854967 podStartE2EDuration="18.462838854s" totalImagesPullingTime="5.943600155s" totalInitContainerRuntime="28.383732ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:18:50.459237205 +0000 UTC m=+97.240496958" watchObservedRunningTime="2026-07-17 21:18:50.462838854 +0000 UTC m=+97.244098583"
Jul 17 21:18:51.096116 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:51.096079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:51.096343 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:51.096142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:18:53.619115 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:18:53.619075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:02.178191 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:02.178161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-22qnq"
Jul 17 21:19:10.141452 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.141399    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-947448f6b-gkfmr" podUID="d098e9ab-0d4e-4190-89dd-8db0672f957c" containerName="console" containerID="cri-o://cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d" gracePeriod=15
Jul 17 21:19:10.472936 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.472907    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:19:10.476295 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.476265    2579 generic.go:356] "Generic (PLEG): container finished" podID="d098e9ab-0d4e-4190-89dd-8db0672f957c" containerID="cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d" exitCode=0
Jul 17 21:19:10.476427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.476300    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-947448f6b-gkfmr"
Jul 17 21:19:10.476427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.476340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-947448f6b-gkfmr" event={"ID":"d098e9ab-0d4e-4190-89dd-8db0672f957c","Type":"ContainerDied","Data":"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"}
Jul 17 21:19:10.476525 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.476460    2579 scope.go:117] "RemoveContainer" containerID="cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"
Jul 17 21:19:10.476525 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.476499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-947448f6b-gkfmr" event={"ID":"d098e9ab-0d4e-4190-89dd-8db0672f957c","Type":"ContainerDied","Data":"12a997228c8f2bd5a80a4360196e8894c48122543bca7183f285554f8c9d90cc"}
Jul 17 21:19:10.486536 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.486511    2579 scope.go:117] "RemoveContainer" containerID="cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"
Jul 17 21:19:10.486865 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:10.486844    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d\": container with ID starting with cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d not found: ID does not exist" containerID="cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"
Jul 17 21:19:10.486960 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.486878    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d"} err="failed to get container status \"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d\": rpc error: code = NotFound desc = could not find container \"cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d\": container with ID starting with cc26e05ba546ed113daf85676f1eb62bc80eec1c3c474a2b7fb862cce7e52e3d not found: ID does not exist"
Jul 17 21:19:10.584085 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584038    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntwzv\" (UniqueName: \"kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.584302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584129    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.584302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.584302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584220    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.584302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584270    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.584524 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.584332    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config\") pod \"d098e9ab-0d4e-4190-89dd-8db0672f957c\" (UID: \"d098e9ab-0d4e-4190-89dd-8db0672f957c\") "
Jul 17 21:19:10.585500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.585229    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config" (OuterVolumeSpecName: "console-config") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:10.589067 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.588395    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:10.589067 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.588740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:10.592982 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.592923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv" (OuterVolumeSpecName: "kube-api-access-ntwzv") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "kube-api-access-ntwzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:19:10.595236 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.595199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:10.595404 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.595373    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d098e9ab-0d4e-4190-89dd-8db0672f957c" (UID: "d098e9ab-0d4e-4190-89dd-8db0672f957c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685194    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685224    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-oauth-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685240    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntwzv\" (UniqueName: \"kubernetes.io/projected/d098e9ab-0d4e-4190-89dd-8db0672f957c-kube-api-access-ntwzv\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685253    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685265    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-console-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.685281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.685280    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d098e9ab-0d4e-4190-89dd-8db0672f957c-oauth-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:10.800503 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.800468    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:19:10.807538 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:10.807508    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-947448f6b-gkfmr"]
Jul 17 21:19:11.107731 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:11.107452    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:19:11.113158 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:11.113129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9bd46598f-2gv7r"
Jul 17 21:19:11.763071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:11.763037    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d098e9ab-0d4e-4190-89dd-8db0672f957c" path="/var/lib/kubelet/pods/d098e9ab-0d4e-4190-89dd-8db0672f957c/volumes"
Jul 17 21:19:33.618448 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:33.618411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:33.688510 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:33.688473    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:34.593309 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:34.593282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:46.750807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.750751    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751044    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="alertmanager" containerID="cri-o://7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38" gracePeriod=120
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751129    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-metric" containerID="cri-o://05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290" gracePeriod=120
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751184    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy" containerID="cri-o://f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91" gracePeriod=120
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751152    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="prom-label-proxy" containerID="cri-o://81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8" gracePeriod=120
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751206    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="config-reloader" containerID="cri-o://7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952" gracePeriod=120
Jul 17 21:19:46.751331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:46.751185    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-web" containerID="cri-o://3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e" gracePeriod=120
Jul 17 21:19:47.633179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633142    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8" exitCode=0
Jul 17 21:19:47.633179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633167    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290" exitCode=0
Jul 17 21:19:47.633179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633173    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91" exitCode=0
Jul 17 21:19:47.633179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633179    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952" exitCode=0
Jul 17 21:19:47.633179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633184    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38" exitCode=0
Jul 17 21:19:47.633456 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"}
Jul 17 21:19:47.633456 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"}
Jul 17 21:19:47.633456 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"}
Jul 17 21:19:47.633456 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"}
Jul 17 21:19:47.633456 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.633358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"}
Jul 17 21:19:47.995264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:47.995239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.120209 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120163    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120392 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120392 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97s8t\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120392 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120392 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120392 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120628 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120628 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120503    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120628 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120543    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120628 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:48.120628 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120594    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120944 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120656    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120944 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.120944 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.120730    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config\") pod \"dbbb36c9-3510-40cf-8423-25ec98a74359\" (UID: \"dbbb36c9-3510-40cf-8423-25ec98a74359\") "
Jul 17 21:19:48.121458 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.121227    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-metrics-client-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.121584 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.121556    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:19:48.123752 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.123693    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out" (OuterVolumeSpecName: "config-out") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:19:48.123878 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.123752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.123941 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.123909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.124298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.124198    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.124298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.124212    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t" (OuterVolumeSpecName: "kube-api-access-97s8t") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "kube-api-access-97s8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:19:48.124298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.124243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:48.124483 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.124424    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.126287 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.126259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.126397 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.126308    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:19:48.128006 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.127906    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.134826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.134804    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config" (OuterVolumeSpecName: "web-config") pod "dbbb36c9-3510-40cf-8423-25ec98a74359" (UID: "dbbb36c9-3510-40cf-8423-25ec98a74359"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222216    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-config-out\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222269    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97s8t\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-kube-api-access-97s8t\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222285    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222298    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-main-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222310    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-web-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222322    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222343    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-main-db\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222356    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-config-volume\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222388    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222399    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbbb36c9-3510-40cf-8423-25ec98a74359-tls-assets\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222411    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbbb36c9-3510-40cf-8423-25ec98a74359-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.222693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.222423    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbbb36c9-3510-40cf-8423-25ec98a74359-cluster-tls-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:48.640538 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.640504    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerID="3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e" exitCode=0
Jul 17 21:19:48.640714 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.640578    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.640714 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.640584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"}
Jul 17 21:19:48.640714 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.640654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbbb36c9-3510-40cf-8423-25ec98a74359","Type":"ContainerDied","Data":"7a9c2e1b5c2871b49e9951b822a35ec72a9a083c20f59e18d4e26a0f02d25152"}
Jul 17 21:19:48.640714 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.640686    2579 scope.go:117] "RemoveContainer" containerID="81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"
Jul 17 21:19:48.650758 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.650735    2579 scope.go:117] "RemoveContainer" containerID="05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"
Jul 17 21:19:48.658959 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.658936    2579 scope.go:117] "RemoveContainer" containerID="f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"
Jul 17 21:19:48.666112 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.666081    2579 scope.go:117] "RemoveContainer" containerID="3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"
Jul 17 21:19:48.669998 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.669978    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:48.673073 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.673045    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:48.674839 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.674822    2579 scope.go:117] "RemoveContainer" containerID="7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"
Jul 17 21:19:48.682353 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.682325    2579 scope.go:117] "RemoveContainer" containerID="7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"
Jul 17 21:19:48.689656 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.689639    2579 scope.go:117] "RemoveContainer" containerID="d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a"
Jul 17 21:19:48.696615 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.696596    2579 scope.go:117] "RemoveContainer" containerID="81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"
Jul 17 21:19:48.696881 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.696864    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8\": container with ID starting with 81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8 not found: ID does not exist" containerID="81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"
Jul 17 21:19:48.696946 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.696891    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8"} err="failed to get container status \"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8\": rpc error: code = NotFound desc = could not find container \"81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8\": container with ID starting with 81ce494f303d27634b6907a0025b34566b21d593c602bf5d25d57b130f2598c8 not found: ID does not exist"
Jul 17 21:19:48.696946 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.696910    2579 scope.go:117] "RemoveContainer" containerID="05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"
Jul 17 21:19:48.697135 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.697118    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290\": container with ID starting with 05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290 not found: ID does not exist" containerID="05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"
Jul 17 21:19:48.697174 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697151    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290"} err="failed to get container status \"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290\": rpc error: code = NotFound desc = could not find container \"05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290\": container with ID starting with 05233566e57c1d40f20e28724babfe53ca1055c07b2ec73e9f6f78a00dbab290 not found: ID does not exist"
Jul 17 21:19:48.697174 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697171    2579 scope.go:117] "RemoveContainer" containerID="f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"
Jul 17 21:19:48.697373 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.697357    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91\": container with ID starting with f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91 not found: ID does not exist" containerID="f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"
Jul 17 21:19:48.697417 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697377    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91"} err="failed to get container status \"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91\": rpc error: code = NotFound desc = could not find container \"f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91\": container with ID starting with f22362cb1d815fb62e1162f129257b1340bd687e04f98caa4c1ff62ffa2fee91 not found: ID does not exist"
Jul 17 21:19:48.697417 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697392    2579 scope.go:117] "RemoveContainer" containerID="3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"
Jul 17 21:19:48.697612 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.697594    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e\": container with ID starting with 3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e not found: ID does not exist" containerID="3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"
Jul 17 21:19:48.697671 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697623    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e"} err="failed to get container status \"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e\": rpc error: code = NotFound desc = could not find container \"3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e\": container with ID starting with 3dac4b06c0abe0a3712ecc3cf80bce40bdddd029b0b883f8f84e96c0472e4f0e not found: ID does not exist"
Jul 17 21:19:48.697671 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697647    2579 scope.go:117] "RemoveContainer" containerID="7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"
Jul 17 21:19:48.697896 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.697880    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952\": container with ID starting with 7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952 not found: ID does not exist" containerID="7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"
Jul 17 21:19:48.697964 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697902    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952"} err="failed to get container status \"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952\": rpc error: code = NotFound desc = could not find container \"7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952\": container with ID starting with 7d47228482ed665dba0138852c00b61de8abf7f70c02dc026ce9c1f3b836f952 not found: ID does not exist"
Jul 17 21:19:48.697964 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.697921    2579 scope.go:117] "RemoveContainer" containerID="7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"
Jul 17 21:19:48.698118 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.698102    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38\": container with ID starting with 7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38 not found: ID does not exist" containerID="7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"
Jul 17 21:19:48.698159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.698122    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38"} err="failed to get container status \"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38\": rpc error: code = NotFound desc = could not find container \"7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38\": container with ID starting with 7f1cebd16a009eb4fc58ab7799a5a2cb34c3a07039ad369f259d391d7922ae38 not found: ID does not exist"
Jul 17 21:19:48.698159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.698137    2579 scope.go:117] "RemoveContainer" containerID="d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a"
Jul 17 21:19:48.698317 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:48.698300    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a\": container with ID starting with d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a not found: ID does not exist" containerID="d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a"
Jul 17 21:19:48.698405 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.698322    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a"} err="failed to get container status \"d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a\": rpc error: code = NotFound desc = could not find container \"d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a\": container with ID starting with d09e8dc153c0502f10452c9f2418667e43aa8dd353a86ed83d36f0e9c6febe4a not found: ID does not exist"
Jul 17 21:19:48.711166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711134    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:48.711493 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711478    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-web"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711497    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-web"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711514    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711523    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711533    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="prom-label-proxy"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711543    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="prom-label-proxy"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711556    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="config-reloader"
Jul 17 21:19:48.711565 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711564    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="config-reloader"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711578    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="alertmanager"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="alertmanager"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711599    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="init-config-reloader"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711607    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="init-config-reloader"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711622    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d098e9ab-0d4e-4190-89dd-8db0672f957c" containerName="console"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711629    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d098e9ab-0d4e-4190-89dd-8db0672f957c" containerName="console"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711641    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-metric"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711648    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-metric"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711746    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="prom-label-proxy"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711757    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="alertmanager"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711784    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711796    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-web"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711806    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d098e9ab-0d4e-4190-89dd-8db0672f957c" containerName="console"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711815    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="config-reloader"
Jul 17 21:19:48.711922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.711823    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" containerName="kube-rbac-proxy-metric"
Jul 17 21:19:48.715760 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.715737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.718540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718521    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59znh\""
Jul 17 21:19:48.718540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 21:19:48.718817 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718793    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 21:19:48.718817 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 21:19:48.718977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718807    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 21:19:48.718977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718842    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 21:19:48.718977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.718935    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 21:19:48.719286 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.719269    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 21:19:48.719368 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.719275    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 21:19:48.724657 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.724637    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 21:19:48.734686 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.734660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:48.827056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtfp\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-kube-api-access-bmtfp\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827260 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-web-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-out\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.827563 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.827412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-out\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtfp\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-kube-api-access-bmtfp\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.928856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.928729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-web-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.929634 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.929607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.929808 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.929737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.930979 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.930320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.931865 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.931716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-out\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.931865 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.931813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.932056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.932031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.932134 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.932071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.932273 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.932248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.932519 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.932454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.932833 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.932813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.933332 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.933311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-web-config\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.934025 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.934007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/039b62ee-4e39-4548-98d3-27c2f572c5e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:48.940204 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:48.940184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtfp\" (UniqueName: \"kubernetes.io/projected/039b62ee-4e39-4548-98d3-27c2f572c5e9-kube-api-access-bmtfp\") pod \"alertmanager-main-0\" (UID: \"039b62ee-4e39-4548-98d3-27c2f572c5e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:49.027326 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.027286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 21:19:49.178895 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.178818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 21:19:49.180979 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:19:49.180953    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039b62ee_4e39_4548_98d3_27c2f572c5e9.slice/crio-ea001444d58c46be8a2f8bc61af3654a572996215135793dee08b889d9dcecaf WatchSource:0}: Error finding container ea001444d58c46be8a2f8bc61af3654a572996215135793dee08b889d9dcecaf: Status 404 returned error can't find the container with id ea001444d58c46be8a2f8bc61af3654a572996215135793dee08b889d9dcecaf
Jul 17 21:19:49.646692 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.646651    2579 generic.go:356] "Generic (PLEG): container finished" podID="039b62ee-4e39-4548-98d3-27c2f572c5e9" containerID="f1e130f93ff720a4048f1da385e141babed4bf85dcd8ac279dbeeb4880a88063" exitCode=0
Jul 17 21:19:49.646875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.646693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerDied","Data":"f1e130f93ff720a4048f1da385e141babed4bf85dcd8ac279dbeeb4880a88063"}
Jul 17 21:19:49.646875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.646797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"ea001444d58c46be8a2f8bc61af3654a572996215135793dee08b889d9dcecaf"}
Jul 17 21:19:49.762756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:49.762728    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbbb36c9-3510-40cf-8423-25ec98a74359" path="/var/lib/kubelet/pods/dbbb36c9-3510-40cf-8423-25ec98a74359/volumes"
Jul 17 21:19:50.653950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.653913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"f1d86483c9ea5ba213ab0e21b56d58700229d7b66cdceffa404c67c4747e9ed5"}
Jul 17 21:19:50.654305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.654005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"411c90610a528734e6881b32230aa4d712a35a82a23d1dee774283c285be8d29"}
Jul 17 21:19:50.654305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.654032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"80e06213b5f380121e0eecdc20a0b5db813727b28039ef1822db1fae471c5893"}
Jul 17 21:19:50.654305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.654057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"4634bb859e18cbe04182effda070f8abb30c76a25efcb682d13ae79aec9b5cdc"}
Jul 17 21:19:50.654305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.654080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"71a5c34271382e6e78e34822134b97bd098466684b020fd94eb81b689075fa7d"}
Jul 17 21:19:50.654305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.654102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"039b62ee-4e39-4548-98d3-27c2f572c5e9","Type":"ContainerStarted","Data":"26029dd959c2d9bc9ade9a22c37dc5fca389d9630dbbe3e18adc481f89ffe8f7"}
Jul 17 21:19:50.690425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.690343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.675173343 podStartE2EDuration="2.690320601s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.147258ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:19:50.689114643 +0000 UTC m=+157.470374370" watchObservedRunningTime="2026-07-17 21:19:50.690320601 +0000 UTC m=+157.471580328"
Jul 17 21:19:50.835457 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.835410    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"]
Jul 17 21:19:50.838432 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.838403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.841167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 21:19:50.841167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 21:19:50.841167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 21:19:50.841167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841082    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 21:19:50.841406 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 21:19:50.841478 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.841462    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-76xj8\""
Jul 17 21:19:50.846163 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.846144    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 21:19:50.848142 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848211 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-federate-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848211 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848211 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrbp\" (UniqueName: \"kubernetes.io/projected/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-kube-api-access-dbrbp\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848337 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-serving-certs-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848337 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.848427 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.848380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-metrics-client-ca\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.855690 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.855657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"]
Jul 17 21:19:50.949744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.949744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-metrics-client-ca\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.949744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.949744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-federate-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950090 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950090 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrbp\" (UniqueName: \"kubernetes.io/projected/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-kube-api-access-dbrbp\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950090 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-serving-certs-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950090 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.949929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950712 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.950590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-metrics-client-ca\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.950842 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.950805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-serving-certs-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.951142 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.951118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.952698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.952671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-federate-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.952854 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.952697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.952933 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.952871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-telemeter-client-tls\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.953069 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.953048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:50.959646 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:50.959622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrbp\" (UniqueName: \"kubernetes.io/projected/6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d-kube-api-access-dbrbp\") pod \"telemeter-client-6fddd4c776-6g4zs\" (UID: \"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d\") " pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:51.142041 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142005    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:51.142365 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142315    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="prometheus" containerID="cri-o://82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44" gracePeriod=600
Jul 17 21:19:51.142365 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142347    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy" containerID="cri-o://d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9" gracePeriod=600
Jul 17 21:19:51.142570 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142369    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="thanos-sidecar" containerID="cri-o://bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d" gracePeriod=600
Jul 17 21:19:51.142570 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142381    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-web" containerID="cri-o://7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f" gracePeriod=600
Jul 17 21:19:51.142570 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142501    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153" gracePeriod=600
Jul 17 21:19:51.142704 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.142636    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="config-reloader" containerID="cri-o://5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5" gracePeriod=600
Jul 17 21:19:51.149291 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.148599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"
Jul 17 21:19:51.325036 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.325001    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fddd4c776-6g4zs"]
Jul 17 21:19:51.327938 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:19:51.327910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa4ae73_0f1c_40c8_afb7_884fa4ca6a2d.slice/crio-bc758bad8a83e99f6785f8ab98d40705d26a91353496b8edc7b530254f508b40 WatchSource:0}: Error finding container bc758bad8a83e99f6785f8ab98d40705d26a91353496b8edc7b530254f508b40: Status 404 returned error can't find the container with id bc758bad8a83e99f6785f8ab98d40705d26a91353496b8edc7b530254f508b40
Jul 17 21:19:51.409682 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.409653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455066    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455133    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnr9h\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455302    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455328    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455358    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455384    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455416    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.455590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.456142 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455604    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.456142 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.455630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2\") pod \"0ba28c2e-f039-4872-b799-f16cc9619daf\" (UID: \"0ba28c2e-f039-4872-b799-f16cc9619daf\") "
Jul 17 21:19:51.456236 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.456190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.456485 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.456459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.457581    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.457596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.457603    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.458721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.458948    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:19:51.459244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.458964    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:19:51.464046 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.464243 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464095    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out" (OuterVolumeSpecName: "config-out") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:19:51.464447 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464394    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config" (OuterVolumeSpecName: "config") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.464915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.464915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464799    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h" (OuterVolumeSpecName: "kube-api-access-rnr9h") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "kube-api-access-rnr9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:19:51.464915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.464915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464876    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.464915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.464900    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.465224 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.465076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:19:51.465940 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.465898    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.466594 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.466573    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.476338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.476292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config" (OuterVolumeSpecName: "web-config") pod "0ba28c2e-f039-4872-b799-f16cc9619daf" (UID: "0ba28c2e-f039-4872-b799-f16cc9619daf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:19:51.556831 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556796    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-metrics-client-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.556831 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556825    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.556831 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556837    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556847    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-metrics-client-certs\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556856    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-tls-assets\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556865    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnr9h\" (UniqueName: \"kubernetes.io/projected/0ba28c2e-f039-4872-b799-f16cc9619daf-kube-api-access-rnr9h\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556873    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-web-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556883    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-kube-rbac-proxy\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556891    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556900    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556909    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-grpc-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556917    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556924    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-config-out\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556932    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556940    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba28c2e-f039-4872-b799-f16cc9619daf-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556949    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556956    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-db\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556964    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556974    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.557053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.556982    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba28c2e-f039-4872-b799-f16cc9619daf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:19:51.662190 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.662150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs" event={"ID":"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d","Type":"ContainerStarted","Data":"bc758bad8a83e99f6785f8ab98d40705d26a91353496b8edc7b530254f508b40"}
Jul 17 21:19:51.665425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665398    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153" exitCode=0
Jul 17 21:19:51.665425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665423    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9" exitCode=0
Jul 17 21:19:51.665425 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665431    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f" exitCode=0
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665438    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d" exitCode=0
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665443    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5" exitCode=0
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665448    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44" exitCode=0
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665468    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"}
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"}
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"}
Jul 17 21:19:51.665627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"}
Jul 17 21:19:51.665917 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665621    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.665917 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"}
Jul 17 21:19:51.665917 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"}
Jul 17 21:19:51.665917 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.665740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba28c2e-f039-4872-b799-f16cc9619daf","Type":"ContainerDied","Data":"0b1373b191efc77b0cecee7c95237b358d74e716dc8857b83e2a41e61d018f4e"}
Jul 17 21:19:51.674471 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.674452    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.681867 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.681845    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.689073 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.689048    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.690744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.690719    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:51.694472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.694446    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:51.697416 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.697399    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.704735 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.704704    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.712630 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.712510    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.719495 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.719480    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.719744 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.719726    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.719816 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.719753    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.719816 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.719792    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.720121 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.720068    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.720121 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720098    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.720121 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720122    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.720541 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.720520    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.720632 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720548    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.720632 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720564    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.720906 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.720882    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.721003 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720912    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.721003 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.720930    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.721360 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.721339    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.721436 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.721366    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.721436 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.721385    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.721686 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.721668    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.721784 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.721695    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.721784 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.721713    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.722061 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:19:51.722044    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.722113 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722067    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.722113 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722082    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.722429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722392    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.722429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722411    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.722670 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722627    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.722782 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722670    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.722935 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722915    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.723012 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.722937    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.723202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723185    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.723271 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723203    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.723352 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723333    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:51.723432 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723412    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.723432 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723431    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.723730 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723704    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723732    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723736    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="prometheus"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723750    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="prometheus"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723779    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723787    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723795    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="init-config-reloader"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723801    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="init-config-reloader"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723814    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-thanos"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723819    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-thanos"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723825    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="config-reloader"
Jul 17 21:19:51.723828 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723830    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="config-reloader"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723835    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-web"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723840    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-web"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723854    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="thanos-sidecar"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723861    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="thanos-sidecar"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723926    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723940    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-thanos"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723948    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="thanos-sidecar"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723958    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="config-reloader"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723966    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="prometheus"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.723981    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" containerName="kube-rbac-proxy-web"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724092    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.724202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724108    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.724557 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724339    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.724557 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724361    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.724671 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724592    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.724671 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724614    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.724844 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724825    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.724896 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.724848    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.725098 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725073    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.725179 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725100    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.725370 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725347    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.725370 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725369    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.725663 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725607    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.725663 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725637    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.725980 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725947    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.725980 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.725969    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.726313 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.726285    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.726313 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.726306    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.726603 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.726583    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.726711 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.726605    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.727389 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.727371    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.727530 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.727389    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.728283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.731982    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732010    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732364    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rl93qob9s1bu\""
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732406    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 21:19:51.732540 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8zcw\""
Jul 17 21:19:51.732869 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 21:19:51.732869 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.732782    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 21:19:51.733327 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733002    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 21:19:51.733327 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733053    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 21:19:51.733460 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 21:19:51.734838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733613    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 21:19:51.734838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 21:19:51.734838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.733943    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 21:19:51.734838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.734755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 21:19:51.735158 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.734788    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 21:19:51.735237 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.735163    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.735237 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.735205    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.736167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.735863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 21:19:51.736665 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.736636    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.736789 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.736667    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.736965 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.736941    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.737049 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737009    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.737402 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737375    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.737402 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737400    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.737735 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737672    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.737735 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737696    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.737987 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737957    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.737987 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.737977    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.738287 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738266    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.738287 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738286    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.738421 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 21:19:51.738619 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738591    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.738674 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738619    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.738950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738928    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.738950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.738949    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.739232 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739210    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.739309 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739234    2579 scope.go:117] "RemoveContainer" containerID="2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"
Jul 17 21:19:51.739512 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739489    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153"} err="failed to get container status \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": rpc error: code = NotFound desc = could not find container \"2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153\": container with ID starting with 2d66317f1d99e9645ba0e8025d7a0a9086152dfc36c00814b6f0025dc8fee153 not found: ID does not exist"
Jul 17 21:19:51.739512 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739514    2579 scope.go:117] "RemoveContainer" containerID="d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"
Jul 17 21:19:51.739786 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739747    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9"} err="failed to get container status \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": rpc error: code = NotFound desc = could not find container \"d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9\": container with ID starting with d7e0eeac8f69d2d5f41560e56ea4d0fa6baa1324627f5588644d62d9c354dfa9 not found: ID does not exist"
Jul 17 21:19:51.739836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.739787    2579 scope.go:117] "RemoveContainer" containerID="7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"
Jul 17 21:19:51.740071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f"} err="failed to get container status \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": rpc error: code = NotFound desc = could not find container \"7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f\": container with ID starting with 7473a92d889d2c855eb8b5754e94aae0c8c2bab66f49ce18e30d253c3f155a7f not found: ID does not exist"
Jul 17 21:19:51.740071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740057    2579 scope.go:117] "RemoveContainer" containerID="bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"
Jul 17 21:19:51.740333 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740314    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d"} err="failed to get container status \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": rpc error: code = NotFound desc = could not find container \"bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d\": container with ID starting with bdb62e8341b53401a929955b02eabaa68f2f5e9b524516aa6d166dbf26c4a42d not found: ID does not exist"
Jul 17 21:19:51.740404 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740333    2579 scope.go:117] "RemoveContainer" containerID="5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"
Jul 17 21:19:51.740535 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740518    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 21:19:51.740582 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740568    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5"} err="failed to get container status \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": rpc error: code = NotFound desc = could not find container \"5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5\": container with ID starting with 5321b2838c0189b78ed22f6a3a21681311d16d5864f8e6950a4ceaa5546a59a5 not found: ID does not exist"
Jul 17 21:19:51.740582 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740580    2579 scope.go:117] "RemoveContainer" containerID="82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"
Jul 17 21:19:51.740793 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740777    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44"} err="failed to get container status \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": rpc error: code = NotFound desc = could not find container \"82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44\": container with ID starting with 82f445e1e96a58685ae1c0a9ebdee74893819c202791f2d393277292f63d3d44 not found: ID does not exist"
Jul 17 21:19:51.740793 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740792    2579 scope.go:117] "RemoveContainer" containerID="54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"
Jul 17 21:19:51.740994 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.740975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07"} err="failed to get container status \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": rpc error: code = NotFound desc = could not find container \"54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07\": container with ID starting with 54bb2d5139780d9678fae5a0eae1a5d239562390630be70ca0b0b227aa688c07 not found: ID does not exist"
Jul 17 21:19:51.743962 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.743939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:51.758990 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.758963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759129 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.758994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp682\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-kube-api-access-lp682\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759129 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759201 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759201 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759201 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759345 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759416 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759476 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759634 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759886 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759886 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759963 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.759963 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.759913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.763076 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.763052    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ba28c2e-f039-4872-b799-f16cc9619daf" path="/var/lib/kubelet/pods/0ba28c2e-f039-4872-b799-f16cc9619daf/volumes"
Jul 17 21:19:51.861225 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861225 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp682\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-kube-api-access-lp682\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.861488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862038 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.861806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862521 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.862360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.862521 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.862412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.863115 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.862837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.863347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.863326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.863462 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.863439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.864678 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.864652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.864812 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.864705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.865089 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.865064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.865537 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.865512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.865972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.865973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.865977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.866097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866561 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.866267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-config\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866561 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.866416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.866830 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.866812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.867852 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.867826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.868016 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.868002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.868060 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.868023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:51.871355 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:51.871339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp682\" (UniqueName: \"kubernetes.io/projected/4d55a4ca-3115-4f9e-8f8f-21bd1c518e06-kube-api-access-lp682\") pod \"prometheus-k8s-0\" (UID: \"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:52.045997 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:52.045962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:19:52.201716 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:52.201483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 21:19:52.204416 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:19:52.204386    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d55a4ca_3115_4f9e_8f8f_21bd1c518e06.slice/crio-8ad6bbad77390480694dcd71fa76c03d87168b988af41e3cce70b1f700a52a24 WatchSource:0}: Error finding container 8ad6bbad77390480694dcd71fa76c03d87168b988af41e3cce70b1f700a52a24: Status 404 returned error can't find the container with id 8ad6bbad77390480694dcd71fa76c03d87168b988af41e3cce70b1f700a52a24
Jul 17 21:19:52.672586 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:52.672548    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d55a4ca-3115-4f9e-8f8f-21bd1c518e06" containerID="fb20701ca79518246a5a6247779cb9b1a304e22ee64d91e26721c4ab0fd63fb1" exitCode=0
Jul 17 21:19:52.673276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:52.672638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerDied","Data":"fb20701ca79518246a5a6247779cb9b1a304e22ee64d91e26721c4ab0fd63fb1"}
Jul 17 21:19:52.673276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:52.672725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"8ad6bbad77390480694dcd71fa76c03d87168b988af41e3cce70b1f700a52a24"}
Jul 17 21:19:53.679840 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.679794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs" event={"ID":"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d","Type":"ContainerStarted","Data":"1f03d9dae0cc248a433ee2a6ae2985d3df310a60a57c3190a6ea714b8040abff"}
Jul 17 21:19:53.680300 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.679913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs" event={"ID":"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d","Type":"ContainerStarted","Data":"5148a203df8e98a1a14999eb795268e2ff4675d3bbbe717852af79bd8db33be6"}
Jul 17 21:19:53.680300 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.679939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs" event={"ID":"6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d","Type":"ContainerStarted","Data":"4bd26ef4292647f57e68624e66593fdc4d376bbc72e88bc41ebeaee51497a758"}
Jul 17 21:19:53.683276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"9b549f3782fbd5cc54817f09b87ef9fcedf131d2f903d68db832abac8feb8e94"}
Jul 17 21:19:53.683426 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"912771e6a908d8ad8775f2a3ab8ce0d66eaae9327cad21063e2b51e8c1c8b82e"}
Jul 17 21:19:53.683426 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"7fb41773b90f0d4d567bc183b88b2d49e53f09a205c71fc904915ba9b9ebef42"}
Jul 17 21:19:53.683426 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"77c1afa88586be024930bc0687f3dc1cb6adad858a4430015bdb248bd5e7367a"}
Jul 17 21:19:53.683582 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"3d09ddb0fdbd40d93a06ad914dcdf314f790e2d2c03de6f6823d93ccd06e2ed6"}
Jul 17 21:19:53.683582 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.683473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d55a4ca-3115-4f9e-8f8f-21bd1c518e06","Type":"ContainerStarted","Data":"287dd72caa1cbd055eb65631108d6a5a9a2e56f9d0ac226ac2fad4c06f04428d"}
Jul 17 21:19:53.703973 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.703907    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fddd4c776-6g4zs" podStartSLOduration=1.721357555 podStartE2EDuration="3.703888071s" totalImagesPullingTime="1.982530516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:19:53.702226157 +0000 UTC m=+160.483485884" watchObservedRunningTime="2026-07-17 21:19:53.703888071 +0000 UTC m=+160.485147801"
Jul 17 21:19:53.732138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:53.732070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.713654589 podStartE2EDuration="2.732053058s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.398469ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:19:53.73154909 +0000 UTC m=+160.512808817" watchObservedRunningTime="2026-07-17 21:19:53.732053058 +0000 UTC m=+160.513312784"
Jul 17 21:19:57.046515 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:19:57.046475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:20:52.046865 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:20:52.046819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:20:52.063457 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:20:52.063426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:20:52.948880 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:20:52.948854    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 21:22:13.586054 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:13.586025    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 21:22:50.011202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.011172    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9mgg"]
Jul 17 21:22:50.014488 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.014471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.017381 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.017356    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9bhcn\""
Jul 17 21:22:50.017491 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.017366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 21:22:50.018609 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.018591    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 21:22:50.026729 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.026706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9mgg"]
Jul 17 21:22:50.053165 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.053130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.053332 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.053176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj85j\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-kube-api-access-wj85j\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.154071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.154031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.154281 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.154087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj85j\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-kube-api-access-wj85j\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.163000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.162971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj85j\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-kube-api-access-wj85j\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.163000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.162981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a490f44-a687-45f3-85a3-f23363fcdc7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9mgg\" (UID: \"1a490f44-a687-45f3-85a3-f23363fcdc7c\") " pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.335539 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.335507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v9mgg"
Jul 17 21:22:50.480087 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.480044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9mgg"]
Jul 17 21:22:50.482894 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:22:50.482867    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a490f44_a687_45f3_85a3_f23363fcdc7c.slice/crio-31750ace72c7160cd7236bea453ab343b4b75ef2dcfd93c160e5b0d1e52b8ee6 WatchSource:0}: Error finding container 31750ace72c7160cd7236bea453ab343b4b75ef2dcfd93c160e5b0d1e52b8ee6: Status 404 returned error can't find the container with id 31750ace72c7160cd7236bea453ab343b4b75ef2dcfd93c160e5b0d1e52b8ee6
Jul 17 21:22:50.484685 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:50.484670    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:22:51.415308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:51.415264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v9mgg" event={"ID":"1a490f44-a687-45f3-85a3-f23363fcdc7c","Type":"ContainerStarted","Data":"31750ace72c7160cd7236bea453ab343b4b75ef2dcfd93c160e5b0d1e52b8ee6"}
Jul 17 21:22:52.211810 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.211751    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"]
Jul 17 21:22:52.222129 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.222091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.224210 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.224155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"]
Jul 17 21:22:52.225348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.225304    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 21:22:52.226196 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.226033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:22:52.226196 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.226074    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5fwnk\""
Jul 17 21:22:52.273204 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.273153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af0802d6-71e5-4253-8778-f1fa7766c140-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.273405 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.273291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ptz\" (UniqueName: \"kubernetes.io/projected/af0802d6-71e5-4253-8778-f1fa7766c140-kube-api-access-l5ptz\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.374018 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.373981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af0802d6-71e5-4253-8778-f1fa7766c140-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.374205 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.374051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ptz\" (UniqueName: \"kubernetes.io/projected/af0802d6-71e5-4253-8778-f1fa7766c140-kube-api-access-l5ptz\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.374473 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.374448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af0802d6-71e5-4253-8778-f1fa7766c140-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.383888 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.383847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ptz\" (UniqueName: \"kubernetes.io/projected/af0802d6-71e5-4253-8778-f1fa7766c140-kube-api-access-l5ptz\") pod \"openshift-lws-operator-fd8ccff4c-k4cwj\" (UID: \"af0802d6-71e5-4253-8778-f1fa7766c140\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:52.538874 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:52.538829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"
Jul 17 21:22:53.650231 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:53.650199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj"]
Jul 17 21:22:53.653825 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:22:53.653796    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf0802d6_71e5_4253_8778_f1fa7766c140.slice/crio-b89353a867bd3599addb3a732cbd3d67716715059d6f9c70534fd13bff0dcbfd WatchSource:0}: Error finding container b89353a867bd3599addb3a732cbd3d67716715059d6f9c70534fd13bff0dcbfd: Status 404 returned error can't find the container with id b89353a867bd3599addb3a732cbd3d67716715059d6f9c70534fd13bff0dcbfd
Jul 17 21:22:54.431350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:54.431261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj" event={"ID":"af0802d6-71e5-4253-8778-f1fa7766c140","Type":"ContainerStarted","Data":"b89353a867bd3599addb3a732cbd3d67716715059d6f9c70534fd13bff0dcbfd"}
Jul 17 21:22:54.433166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:54.433139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v9mgg" event={"ID":"1a490f44-a687-45f3-85a3-f23363fcdc7c","Type":"ContainerStarted","Data":"73eb68d79427df297c1e01651a5c9ea847ddb4a3ae04029197fd07571f1c4ea7"}
Jul 17 21:22:54.452784 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:54.452721    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v9mgg" podStartSLOduration=2.348626223 podStartE2EDuration="5.452702977s" totalImagesPullingTime="3.104076754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:22:54.452112346 +0000 UTC m=+341.233372073" watchObservedRunningTime="2026-07-17 21:22:54.452702977 +0000 UTC m=+341.233962703"
Jul 17 21:22:56.446784 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:56.446727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj" event={"ID":"af0802d6-71e5-4253-8778-f1fa7766c140","Type":"ContainerStarted","Data":"a75e0ab88e399204905975c055800122ded8173fc2b9fae62b24f103a813957c"}
Jul 17 21:22:56.466044 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:22:56.465989    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k4cwj" podStartSLOduration=1.764837932 podStartE2EDuration="4.465972863s" totalImagesPullingTime="2.701134931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:22:56.464798768 +0000 UTC m=+343.246058496" watchObservedRunningTime="2026-07-17 21:22:56.465972863 +0000 UTC m=+343.247232591"
Jul 17 21:23:15.828572 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.828489    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"]
Jul 17 21:23:15.832305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.832288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:15.836646 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.836623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6d45\""
Jul 17 21:23:15.836793 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.836652    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 21:23:15.837167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.837148    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 21:23:15.837167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.837165    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 21:23:15.837315 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.837277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 21:23:15.851492 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.851467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"]
Jul 17 21:23:15.992926 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.992884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-manifests\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:15.992926 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.992924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:15.993164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.992949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:15.993164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.993095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-tmp\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:15.993164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:15.993122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn45b\" (UniqueName: \"kubernetes.io/projected/1e2b6831-9412-41bd-a8d5-52c5efe397ea-kube-api-access-cn45b\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094085 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.093952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-tmp\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094085 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.094044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn45b\" (UniqueName: \"kubernetes.io/projected/1e2b6831-9412-41bd-a8d5-52c5efe397ea-kube-api-access-cn45b\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094085 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.094078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-manifests\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.094099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.094136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.094527 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.094510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-manifests\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.096507 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.096473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2b6831-9412-41bd-a8d5-52c5efe397ea-tmp\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.096643 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.096528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.096643 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.096593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e2b6831-9412-41bd-a8d5-52c5efe397ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.104394 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.104365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn45b\" (UniqueName: \"kubernetes.io/projected/1e2b6831-9412-41bd-a8d5-52c5efe397ea-kube-api-access-cn45b\") pod \"opendatahub-operator-controller-manager-6d6dbd9688-tjpp6\" (UID: \"1e2b6831-9412-41bd-a8d5-52c5efe397ea\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.143321 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.143280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:16.297654 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.297630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"]
Jul 17 21:23:16.300635 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:23:16.300606    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2b6831_9412_41bd_a8d5_52c5efe397ea.slice/crio-42e5067910778f7eb156689d6be254c098ab4045762ecf87f3c03fdb0f555f33 WatchSource:0}: Error finding container 42e5067910778f7eb156689d6be254c098ab4045762ecf87f3c03fdb0f555f33: Status 404 returned error can't find the container with id 42e5067910778f7eb156689d6be254c098ab4045762ecf87f3c03fdb0f555f33
Jul 17 21:23:16.536306 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:16.536272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6" event={"ID":"1e2b6831-9412-41bd-a8d5-52c5efe397ea","Type":"ContainerStarted","Data":"42e5067910778f7eb156689d6be254c098ab4045762ecf87f3c03fdb0f555f33"}
Jul 17 21:23:19.554316 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:19.554279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6" event={"ID":"1e2b6831-9412-41bd-a8d5-52c5efe397ea","Type":"ContainerStarted","Data":"8ccbc2f40fef49779ec0e3168e67accf5fa59bfe7d92cff79944ce5161937a86"}
Jul 17 21:23:20.560056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:20.560015    2579 generic.go:356] "Generic (PLEG): container finished" podID="1e2b6831-9412-41bd-a8d5-52c5efe397ea" containerID="8ccbc2f40fef49779ec0e3168e67accf5fa59bfe7d92cff79944ce5161937a86" exitCode=0
Jul 17 21:23:20.560443 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:20.560103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6" event={"ID":"1e2b6831-9412-41bd-a8d5-52c5efe397ea","Type":"ContainerDied","Data":"8ccbc2f40fef49779ec0e3168e67accf5fa59bfe7d92cff79944ce5161937a86"}
Jul 17 21:23:21.567602 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:21.567564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6" event={"ID":"1e2b6831-9412-41bd-a8d5-52c5efe397ea","Type":"ContainerStarted","Data":"8258dfb0cf535dfe5f18122e8d32eec40dc134a29de27c52f25fa017ed8ba622"}
Jul 17 21:23:21.568196 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:21.567649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:21.592472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:21.592421    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6" podStartSLOduration=2.261894722 podStartE2EDuration="6.592405524s" totalImagesPullingTime="3.263925796s" totalInitContainerRuntime="1.066585006s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:23:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:23:21.589931833 +0000 UTC m=+368.371191561" watchObservedRunningTime="2026-07-17 21:23:21.592405524 +0000 UTC m=+368.373665251"
Jul 17 21:23:32.574263 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:32.574231    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6dbd9688-tjpp6"
Jul 17 21:23:34.293349 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.293309    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"]
Jul 17 21:23:34.296061 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.296041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.299631 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.299607    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sq5l8\""
Jul 17 21:23:34.299787 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.299650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 21:23:34.299787 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.299675    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 21:23:34.299787 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.299714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 21:23:34.307380 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.307354    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"]
Jul 17 21:23:34.350836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.350800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.350836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.350840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t89jp\" (UniqueName: \"kubernetes.io/projected/77a566c0-7d93-4097-9d0b-1197554f5b08-kube-api-access-t89jp\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.351053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.350868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77a566c0-7d93-4097-9d0b-1197554f5b08-manager-config\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.351053 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.350920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-metrics-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.451464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.451427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.451464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.451468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t89jp\" (UniqueName: \"kubernetes.io/projected/77a566c0-7d93-4097-9d0b-1197554f5b08-kube-api-access-t89jp\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.451698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.451602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77a566c0-7d93-4097-9d0b-1197554f5b08-manager-config\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.451698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.451681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-metrics-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.452249 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.452222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77a566c0-7d93-4097-9d0b-1197554f5b08-manager-config\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.454009 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.453988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.454313 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.454295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77a566c0-7d93-4097-9d0b-1197554f5b08-metrics-cert\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.479731 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.479694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t89jp\" (UniqueName: \"kubernetes.io/projected/77a566c0-7d93-4097-9d0b-1197554f5b08-kube-api-access-t89jp\") pod \"lws-controller-manager-76f7bc5b6f-7l8wh\" (UID: \"77a566c0-7d93-4097-9d0b-1197554f5b08\") " pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.605371 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.605280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:34.753844 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:34.753652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"]
Jul 17 21:23:34.756571 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:23:34.756545    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a566c0_7d93_4097_9d0b_1197554f5b08.slice/crio-7379db7c9c3d03d9a10130a365ff95337f324cbad3b72affda8e9ed2d4172dac WatchSource:0}: Error finding container 7379db7c9c3d03d9a10130a365ff95337f324cbad3b72affda8e9ed2d4172dac: Status 404 returned error can't find the container with id 7379db7c9c3d03d9a10130a365ff95337f324cbad3b72affda8e9ed2d4172dac
Jul 17 21:23:35.634176 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.634134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh" event={"ID":"77a566c0-7d93-4097-9d0b-1197554f5b08","Type":"ContainerStarted","Data":"7379db7c9c3d03d9a10130a365ff95337f324cbad3b72affda8e9ed2d4172dac"}
Jul 17 21:23:35.827681 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.827633    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"]
Jul 17 21:23:35.830758 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.830734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.843271 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.843237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 21:23:35.843547 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.843524    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 21:23:35.843653 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.843590    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8s8c5\""
Jul 17 21:23:35.843726 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.843537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 21:23:35.843853 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.843835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 21:23:35.864078 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.863956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tls-certs\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.864078 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.864003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm5rb\" (UniqueName: \"kubernetes.io/projected/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-kube-api-access-jm5rb\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.864078 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.864063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tmp\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.867054 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.867021    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"]
Jul 17 21:23:35.964878 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.964560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tls-certs\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.964878 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.964622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm5rb\" (UniqueName: \"kubernetes.io/projected/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-kube-api-access-jm5rb\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.964878 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.964694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tmp\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.967583 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.967560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tls-certs\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.967709 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.967694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-tmp\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:35.986064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:35.986040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm5rb\" (UniqueName: \"kubernetes.io/projected/fe852751-8f1c-40ea-ad62-d69b3e09bf3b-kube-api-access-jm5rb\") pod \"kube-auth-proxy-5fbb8dc498-tghfg\" (UID: \"fe852751-8f1c-40ea-ad62-d69b3e09bf3b\") " pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:36.145729 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:36.145689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"
Jul 17 21:23:36.673165 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:36.673135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg"]
Jul 17 21:23:36.675354 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:23:36.675306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe852751_8f1c_40ea_ad62_d69b3e09bf3b.slice/crio-dae72900932e5b9bed21b35fba16f1799ca26f370dc141c2d706772c80e8c00e WatchSource:0}: Error finding container dae72900932e5b9bed21b35fba16f1799ca26f370dc141c2d706772c80e8c00e: Status 404 returned error can't find the container with id dae72900932e5b9bed21b35fba16f1799ca26f370dc141c2d706772c80e8c00e
Jul 17 21:23:37.646255 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:37.646213    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh" event={"ID":"77a566c0-7d93-4097-9d0b-1197554f5b08","Type":"ContainerStarted","Data":"46be360ee0bf9311f7db013c88d5f889a5c5ba95593fea01ec0658b97c2b7816"}
Jul 17 21:23:37.646476 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:37.646386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:23:37.647680 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:37.647652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg" event={"ID":"fe852751-8f1c-40ea-ad62-d69b3e09bf3b","Type":"ContainerStarted","Data":"dae72900932e5b9bed21b35fba16f1799ca26f370dc141c2d706772c80e8c00e"}
Jul 17 21:23:39.659905 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:39.659870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg" event={"ID":"fe852751-8f1c-40ea-ad62-d69b3e09bf3b","Type":"ContainerStarted","Data":"10811e51afe3c6db606872f0dd0cfe7504809bc35ced3bc9d99e82d4946e60f1"}
Jul 17 21:23:39.680539 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:39.680486    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fbb8dc498-tghfg" podStartSLOduration=2.369541026 podStartE2EDuration="4.680471048s" totalImagesPullingTime="2.310930022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:23:39.679108635 +0000 UTC m=+386.460368367" watchObservedRunningTime="2026-07-17 21:23:39.680471048 +0000 UTC m=+386.461730774"
Jul 17 21:23:39.681875 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:39.681840    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh" podStartSLOduration=3.8866640180000003 podStartE2EDuration="5.681827323s" totalImagesPullingTime="1.795163305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:23:37.670781488 +0000 UTC m=+384.452041211" watchObservedRunningTime="2026-07-17 21:23:39.681827323 +0000 UTC m=+386.463087051"
Jul 17 21:23:48.656921 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:23:48.656885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76f7bc5b6f-7l8wh"
Jul 17 21:25:04.829371 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.829336    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6889c48974-6vtjx"]
Jul 17 21:25:04.831773 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.831743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.834511 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.834487    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 21:25:04.834673 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.834658    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pxj2w\""
Jul 17 21:25:04.835495 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.835472    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 21:25:04.835619 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.835520    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 21:25:04.835619 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.835600    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 21:25:04.835735 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.835622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 21:25:04.840839 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.840822    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 21:25:04.851493 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.851464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6889c48974-6vtjx"]
Jul 17 21:25:04.933496 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-service-ca\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-trusted-ca-bundle\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-oauth-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-oauth-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxjc\" (UniqueName: \"kubernetes.io/projected/1a4a6035-b88b-4f60-986c-35a610ff3a6f-kube-api-access-9cxjc\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933689 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:04.933915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:04.933712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.034892 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.034848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-service-ca\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.034917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-trusted-ca-bundle\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.034949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-oauth-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.034978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-oauth-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxjc\" (UniqueName: \"kubernetes.io/projected/1a4a6035-b88b-4f60-986c-35a610ff3a6f-kube-api-access-9cxjc\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035358 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035754 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-oauth-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035912 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035912 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-trusted-ca-bundle\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.035912 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.035882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4a6035-b88b-4f60-986c-35a610ff3a6f-service-ca\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.037516 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.037487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-oauth-config\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.037679 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.037654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4a6035-b88b-4f60-986c-35a610ff3a6f-console-serving-cert\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.044490 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.044470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxjc\" (UniqueName: \"kubernetes.io/projected/1a4a6035-b88b-4f60-986c-35a610ff3a6f-kube-api-access-9cxjc\") pod \"console-6889c48974-6vtjx\" (UID: \"1a4a6035-b88b-4f60-986c-35a610ff3a6f\") " pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.141955 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.141876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:05.294057 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:05.294031    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6889c48974-6vtjx"]
Jul 17 21:25:05.296171 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:25:05.296141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4a6035_b88b_4f60_986c_35a610ff3a6f.slice/crio-7c3dd53a8dbe67e836feb0c307ea8f97898d05b7642fc5e3295c084fb50b0945 WatchSource:0}: Error finding container 7c3dd53a8dbe67e836feb0c307ea8f97898d05b7642fc5e3295c084fb50b0945: Status 404 returned error can't find the container with id 7c3dd53a8dbe67e836feb0c307ea8f97898d05b7642fc5e3295c084fb50b0945
Jul 17 21:25:06.064851 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:06.064815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6889c48974-6vtjx" event={"ID":"1a4a6035-b88b-4f60-986c-35a610ff3a6f","Type":"ContainerStarted","Data":"c69e6582219fd7a9870714b742dc5e0882d03f7c1d017ef1f555089c7edfd0a3"}
Jul 17 21:25:06.065221 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:06.064869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6889c48974-6vtjx" event={"ID":"1a4a6035-b88b-4f60-986c-35a610ff3a6f","Type":"ContainerStarted","Data":"7c3dd53a8dbe67e836feb0c307ea8f97898d05b7642fc5e3295c084fb50b0945"}
Jul 17 21:25:06.084397 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:06.084339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6889c48974-6vtjx" podStartSLOduration=2.084319812 podStartE2EDuration="2.084319812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:25:06.083829081 +0000 UTC m=+472.865088808" watchObservedRunningTime="2026-07-17 21:25:06.084319812 +0000 UTC m=+472.865579539"
Jul 17 21:25:15.142633 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:15.142598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:15.143046 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:15.142652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:15.147300 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:15.147274    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:16.115101 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:16.115071    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6889c48974-6vtjx"
Jul 17 21:25:30.627832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.627798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"]
Jul 17 21:25:30.630446 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.630429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:30.633135 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.633109    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 21:25:30.634058 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.634039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fqtx5\""
Jul 17 21:25:30.634181 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.634085    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 21:25:30.648834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.648806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"]
Jul 17 21:25:30.675586 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.675552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pq5x\" (UniqueName: \"kubernetes.io/projected/c0858505-4ba4-4b94-a833-c64edc64120d-kube-api-access-6pq5x\") pod \"limitador-operator-controller-manager-859d7b78bd-rnhx4\" (UID: \"c0858505-4ba4-4b94-a833-c64edc64120d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:30.777121 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.777078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pq5x\" (UniqueName: \"kubernetes.io/projected/c0858505-4ba4-4b94-a833-c64edc64120d-kube-api-access-6pq5x\") pod \"limitador-operator-controller-manager-859d7b78bd-rnhx4\" (UID: \"c0858505-4ba4-4b94-a833-c64edc64120d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:30.790915 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.790885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pq5x\" (UniqueName: \"kubernetes.io/projected/c0858505-4ba4-4b94-a833-c64edc64120d-kube-api-access-6pq5x\") pod \"limitador-operator-controller-manager-859d7b78bd-rnhx4\" (UID: \"c0858505-4ba4-4b94-a833-c64edc64120d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:30.943305 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:30.943217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:31.101176 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:31.101151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"]
Jul 17 21:25:31.102785 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:25:31.102741    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0858505_4ba4_4b94_a833_c64edc64120d.slice/crio-bee6942254c9646a8095ea196d2ef922fceaed11c095f3f78e41f5086f2bc0be WatchSource:0}: Error finding container bee6942254c9646a8095ea196d2ef922fceaed11c095f3f78e41f5086f2bc0be: Status 404 returned error can't find the container with id bee6942254c9646a8095ea196d2ef922fceaed11c095f3f78e41f5086f2bc0be
Jul 17 21:25:31.183167 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:31.183121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4" event={"ID":"c0858505-4ba4-4b94-a833-c64edc64120d","Type":"ContainerStarted","Data":"bee6942254c9646a8095ea196d2ef922fceaed11c095f3f78e41f5086f2bc0be"}
Jul 17 21:25:33.198798 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:33.198681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4" event={"ID":"c0858505-4ba4-4b94-a833-c64edc64120d","Type":"ContainerStarted","Data":"7a6017a80bdbfae7b1dd44b2e20ea135806f667405c220187ca8cb44ef936624"}
Jul 17 21:25:33.198798 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:33.198755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:25:33.221383 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:33.221330    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4" podStartSLOduration=1.444961746 podStartE2EDuration="3.22131497s" totalImagesPullingTime="1.776353224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:25:33.219268086 +0000 UTC m=+500.000527806" watchObservedRunningTime="2026-07-17 21:25:33.22131497 +0000 UTC m=+500.002574698"
Jul 17 21:25:44.206849 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:25:44.206815    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnhx4"
Jul 17 21:26:13.883166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:13.883090    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:13.887429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:13.887405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:13.890500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:13.890471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlptf\""
Jul 17 21:26:13.894799 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:13.894752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:13.973529 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:13.973487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghkpd\" (UniqueName: \"kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd\") pod \"authorino-58cd955675-xdpnf\" (UID: \"d3ec1511-6b0b-4601-91d9-76b84a02380e\") " pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:14.074808 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:14.074744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghkpd\" (UniqueName: \"kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd\") pod \"authorino-58cd955675-xdpnf\" (UID: \"d3ec1511-6b0b-4601-91d9-76b84a02380e\") " pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:14.099947 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:14.099910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghkpd\" (UniqueName: \"kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd\") pod \"authorino-58cd955675-xdpnf\" (UID: \"d3ec1511-6b0b-4601-91d9-76b84a02380e\") " pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:14.199674 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:14.199573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:14.337102 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:14.337074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:14.339042 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:26:14.339012    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3ec1511_6b0b_4601_91d9_76b84a02380e.slice/crio-05080a8e3eb4b5a1a90fdc40dcb712c9d513d5dcf55db23806400846bc921006 WatchSource:0}: Error finding container 05080a8e3eb4b5a1a90fdc40dcb712c9d513d5dcf55db23806400846bc921006: Status 404 returned error can't find the container with id 05080a8e3eb4b5a1a90fdc40dcb712c9d513d5dcf55db23806400846bc921006
Jul 17 21:26:14.397980 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:14.397942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xdpnf" event={"ID":"d3ec1511-6b0b-4601-91d9-76b84a02380e","Type":"ContainerStarted","Data":"05080a8e3eb4b5a1a90fdc40dcb712c9d513d5dcf55db23806400846bc921006"}
Jul 17 21:26:18.423451 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:18.423416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xdpnf" event={"ID":"d3ec1511-6b0b-4601-91d9-76b84a02380e","Type":"ContainerStarted","Data":"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"}
Jul 17 21:26:18.444205 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:18.444149    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xdpnf" podStartSLOduration=2.084566245 podStartE2EDuration="5.444130547s" totalImagesPullingTime="3.359564302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:26:18.441793923 +0000 UTC m=+545.223053649" watchObservedRunningTime="2026-07-17 21:26:18.444130547 +0000 UTC m=+545.225390274"
Jul 17 21:26:19.203110 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:19.203076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:20.433809 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:20.433723    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xdpnf" podUID="d3ec1511-6b0b-4601-91d9-76b84a02380e" containerName="authorino" containerID="cri-o://a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6" gracePeriod=30
Jul 17 21:26:20.683147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:20.683123    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:20.736831 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:20.736707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghkpd\" (UniqueName: \"kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd\") pod \"d3ec1511-6b0b-4601-91d9-76b84a02380e\" (UID: \"d3ec1511-6b0b-4601-91d9-76b84a02380e\") "
Jul 17 21:26:20.739047 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:20.739013    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd" (OuterVolumeSpecName: "kube-api-access-ghkpd") pod "d3ec1511-6b0b-4601-91d9-76b84a02380e" (UID: "d3ec1511-6b0b-4601-91d9-76b84a02380e"). InnerVolumeSpecName "kube-api-access-ghkpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:26:20.838006 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:20.837968    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghkpd\" (UniqueName: \"kubernetes.io/projected/d3ec1511-6b0b-4601-91d9-76b84a02380e-kube-api-access-ghkpd\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:26:21.440070 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.440036    2579 generic.go:356] "Generic (PLEG): container finished" podID="d3ec1511-6b0b-4601-91d9-76b84a02380e" containerID="a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6" exitCode=0
Jul 17 21:26:21.440450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.440083    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xdpnf"
Jul 17 21:26:21.440450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.440092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xdpnf" event={"ID":"d3ec1511-6b0b-4601-91d9-76b84a02380e","Type":"ContainerDied","Data":"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"}
Jul 17 21:26:21.440450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.440124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xdpnf" event={"ID":"d3ec1511-6b0b-4601-91d9-76b84a02380e","Type":"ContainerDied","Data":"05080a8e3eb4b5a1a90fdc40dcb712c9d513d5dcf55db23806400846bc921006"}
Jul 17 21:26:21.440450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.440139    2579 scope.go:117] "RemoveContainer" containerID="a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"
Jul 17 21:26:21.449226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.449208    2579 scope.go:117] "RemoveContainer" containerID="a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"
Jul 17 21:26:21.449527 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:26:21.449510    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6\": container with ID starting with a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6 not found: ID does not exist" containerID="a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"
Jul 17 21:26:21.449577 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.449535    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6"} err="failed to get container status \"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6\": rpc error: code = NotFound desc = could not find container \"a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6\": container with ID starting with a60d64cb52a8aa5ee992c8df1a5a4c86adf6a79734178d4b74d1d39dbc9680e6 not found: ID does not exist"
Jul 17 21:26:21.470159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.470123    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:21.471905 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.471883    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xdpnf"]
Jul 17 21:26:21.762177 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:21.762096    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ec1511-6b0b-4601-91d9-76b84a02380e" path="/var/lib/kubelet/pods/d3ec1511-6b0b-4601-91d9-76b84a02380e/volumes"
Jul 17 21:26:41.473857 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.473822    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d82mc"]
Jul 17 21:26:41.474321 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.474184    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ec1511-6b0b-4601-91d9-76b84a02380e" containerName="authorino"
Jul 17 21:26:41.474321 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.474195    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ec1511-6b0b-4601-91d9-76b84a02380e" containerName="authorino"
Jul 17 21:26:41.474321 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.474266    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ec1511-6b0b-4601-91d9-76b84a02380e" containerName="authorino"
Jul 17 21:26:41.478995 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.478973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:41.481413 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.481386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlptf\""
Jul 17 21:26:41.484610 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.484587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d82mc"]
Jul 17 21:26:41.634304 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.634270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtp5z\" (UniqueName: \"kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z\") pod \"authorino-5d4b67c446-d82mc\" (UID: \"e131c683-273f-471d-b314-28a5fc9880aa\") " pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:41.700524 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.700490    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d82mc"]
Jul 17 21:26:41.700812 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:26:41.700792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dtp5z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-d82mc" podUID="e131c683-273f-471d-b314-28a5fc9880aa"
Jul 17 21:26:41.725500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.725420    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674b776c54-btxmk"]
Jul 17 21:26:41.727936 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.727918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:41.735109 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.735086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtp5z\" (UniqueName: \"kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z\") pod \"authorino-5d4b67c446-d82mc\" (UID: \"e131c683-273f-471d-b314-28a5fc9880aa\") " pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:41.738220 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.738199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674b776c54-btxmk"]
Jul 17 21:26:41.745098 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.745074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtp5z\" (UniqueName: \"kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z\") pod \"authorino-5d4b67c446-d82mc\" (UID: \"e131c683-273f-471d-b314-28a5fc9880aa\") " pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:41.836541 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.836501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqwh\" (UniqueName: \"kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh\") pod \"authorino-674b776c54-btxmk\" (UID: \"4811477e-76dd-47dd-a833-4464ff0f5366\") " pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:41.937662 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.937622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqwh\" (UniqueName: \"kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh\") pod \"authorino-674b776c54-btxmk\" (UID: \"4811477e-76dd-47dd-a833-4464ff0f5366\") " pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:41.947814 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.947774    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674b776c54-btxmk"]
Jul 17 21:26:41.948065 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:26:41.948045    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-txqwh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-674b776c54-btxmk" podUID="4811477e-76dd-47dd-a833-4464ff0f5366"
Jul 17 21:26:41.951535 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:41.951505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqwh\" (UniqueName: \"kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh\") pod \"authorino-674b776c54-btxmk\" (UID: \"4811477e-76dd-47dd-a833-4464ff0f5366\") " pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:42.538213 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.538184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:42.538643 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.538184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:42.544845 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.544822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:42.548221 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.548203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:42.643937 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.643901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtp5z\" (UniqueName: \"kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z\") pod \"e131c683-273f-471d-b314-28a5fc9880aa\" (UID: \"e131c683-273f-471d-b314-28a5fc9880aa\") "
Jul 17 21:26:42.644140 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.643998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txqwh\" (UniqueName: \"kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh\") pod \"4811477e-76dd-47dd-a833-4464ff0f5366\" (UID: \"4811477e-76dd-47dd-a833-4464ff0f5366\") "
Jul 17 21:26:42.646206 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.646169    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z" (OuterVolumeSpecName: "kube-api-access-dtp5z") pod "e131c683-273f-471d-b314-28a5fc9880aa" (UID: "e131c683-273f-471d-b314-28a5fc9880aa"). InnerVolumeSpecName "kube-api-access-dtp5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:26:42.646329 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.646218    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh" (OuterVolumeSpecName: "kube-api-access-txqwh") pod "4811477e-76dd-47dd-a833-4464ff0f5366" (UID: "4811477e-76dd-47dd-a833-4464ff0f5366"). InnerVolumeSpecName "kube-api-access-txqwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:26:42.744823 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.744790    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtp5z\" (UniqueName: \"kubernetes.io/projected/e131c683-273f-471d-b314-28a5fc9880aa-kube-api-access-dtp5z\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:26:42.744823 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:42.744820    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txqwh\" (UniqueName: \"kubernetes.io/projected/4811477e-76dd-47dd-a833-4464ff0f5366-kube-api-access-txqwh\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:26:43.543169 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.543139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d82mc"
Jul 17 21:26:43.543563 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.543139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b776c54-btxmk"
Jul 17 21:26:43.578014 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.577982    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674b776c54-btxmk"]
Jul 17 21:26:43.583105 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.583075    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674b776c54-btxmk"]
Jul 17 21:26:43.609753 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.609712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d82mc"]
Jul 17 21:26:43.612244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.612216    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d82mc"]
Jul 17 21:26:43.763595 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.763560    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4811477e-76dd-47dd-a833-4464ff0f5366" path="/var/lib/kubelet/pods/4811477e-76dd-47dd-a833-4464ff0f5366/volumes"
Jul 17 21:26:43.763834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:43.763821    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e131c683-273f-471d-b314-28a5fc9880aa" path="/var/lib/kubelet/pods/e131c683-273f-471d-b314-28a5fc9880aa/volumes"
Jul 17 21:26:51.562154 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.562121    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:26:51.564835 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.564819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.568034 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.568006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5ll9z\""
Jul 17 21:26:51.568176 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.568043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:26:51.568738 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.568720    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:26:51.585097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.585064    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:26:51.625854 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.625821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.625854 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.625855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6qx\" (UniqueName: \"kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.726527 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.726479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.726725 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.726537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6qx\" (UniqueName: \"kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.729187 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.729166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.740880 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.740847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6qx\" (UniqueName: \"kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx\") pod \"maas-controller-55d6b7c649-vbj7g\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") " pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.746712 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.746675    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:26:51.749929 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.749905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.763975 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.763947    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:26:51.827588 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.827492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8qvr\" (UniqueName: \"kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.827588 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.827569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.875320 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.875289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:51.928702 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.928648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.928838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.928809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8qvr\" (UniqueName: \"kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.932550 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.932528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:51.939000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:51.938882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8qvr\" (UniqueName: \"kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr\") pod \"maas-controller-bdd5689cb-c8rpn\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") " pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:52.019042 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:52.019016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:26:52.021658 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:26:52.021626    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda5359d_5d91_4722_b11d_993d08a957ed.slice/crio-d79dca949f4115621b0a28458032bfa7c2390aa4ce75a2edea691d382716b384 WatchSource:0}: Error finding container d79dca949f4115621b0a28458032bfa7c2390aa4ce75a2edea691d382716b384: Status 404 returned error can't find the container with id d79dca949f4115621b0a28458032bfa7c2390aa4ce75a2edea691d382716b384
Jul 17 21:26:52.062269 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:52.062241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:52.202143 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:52.202116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:26:52.204367 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:26:52.204345    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda749dfbc_b957_45dd_b18a_a8607f952345.slice/crio-dc4a025dcf1e057b73c0fea8fee783859f4fb275c81c4387b45f6b8884758efc WatchSource:0}: Error finding container dc4a025dcf1e057b73c0fea8fee783859f4fb275c81c4387b45f6b8884758efc: Status 404 returned error can't find the container with id dc4a025dcf1e057b73c0fea8fee783859f4fb275c81c4387b45f6b8884758efc
Jul 17 21:26:52.588259 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:52.588220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" event={"ID":"eda5359d-5d91-4722-b11d-993d08a957ed","Type":"ContainerStarted","Data":"d79dca949f4115621b0a28458032bfa7c2390aa4ce75a2edea691d382716b384"}
Jul 17 21:26:52.589413 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:52.589386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" event={"ID":"a749dfbc-b957-45dd-b18a-a8607f952345","Type":"ContainerStarted","Data":"dc4a025dcf1e057b73c0fea8fee783859f4fb275c81c4387b45f6b8884758efc"}
Jul 17 21:26:55.610849 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:55.610808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" event={"ID":"eda5359d-5d91-4722-b11d-993d08a957ed","Type":"ContainerStarted","Data":"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"}
Jul 17 21:26:55.611303 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:55.610906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:26:55.612335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:55.612313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" event={"ID":"a749dfbc-b957-45dd-b18a-a8607f952345","Type":"ContainerStarted","Data":"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"}
Jul 17 21:26:55.612448 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:55.612371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:26:55.635505 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:26:55.635463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" podStartSLOduration=1.651093014 podStartE2EDuration="4.635449254s" totalImagesPullingTime="2.98435624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:26:55.634331502 +0000 UTC m=+582.415591209" watchObservedRunningTime="2026-07-17 21:26:55.635449254 +0000 UTC m=+582.416708981"
Jul 17 21:27:06.619209 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.619181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:27:06.619783 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.619255    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:27:06.638162 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.638106    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" podStartSLOduration=12.849954733 podStartE2EDuration="15.63809227s" totalImagesPullingTime="2.788137537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:26:55.654871436 +0000 UTC m=+582.436131176" watchObservedRunningTime="2026-07-17 21:27:06.63809227 +0000 UTC m=+593.419351995"
Jul 17 21:27:06.683641 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.683604    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:27:06.683874 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.683822    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" podUID="eda5359d-5d91-4722-b11d-993d08a957ed" containerName="manager" containerID="cri-o://ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81" gracePeriod=30
Jul 17 21:27:06.938586 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:06.938563    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:27:07.070630 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.070592    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt6qx\" (UniqueName: \"kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx\") pod \"eda5359d-5d91-4722-b11d-993d08a957ed\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") "
Jul 17 21:27:07.070847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.070652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert\") pod \"eda5359d-5d91-4722-b11d-993d08a957ed\" (UID: \"eda5359d-5d91-4722-b11d-993d08a957ed\") "
Jul 17 21:27:07.072863 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.072834    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx" (OuterVolumeSpecName: "kube-api-access-vt6qx") pod "eda5359d-5d91-4722-b11d-993d08a957ed" (UID: "eda5359d-5d91-4722-b11d-993d08a957ed"). InnerVolumeSpecName "kube-api-access-vt6qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:27:07.073004 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.072972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eda5359d-5d91-4722-b11d-993d08a957ed" (UID: "eda5359d-5d91-4722-b11d-993d08a957ed"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:27:07.171821 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.171701    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt6qx\" (UniqueName: \"kubernetes.io/projected/eda5359d-5d91-4722-b11d-993d08a957ed-kube-api-access-vt6qx\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:27:07.171821 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.171735    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eda5359d-5d91-4722-b11d-993d08a957ed-webhook-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:27:07.676683 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.676644    2579 generic.go:356] "Generic (PLEG): container finished" podID="eda5359d-5d91-4722-b11d-993d08a957ed" containerID="ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81" exitCode=0
Jul 17 21:27:07.676683 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.676684    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d6b7c649-vbj7g"
Jul 17 21:27:07.677301 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.676718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" event={"ID":"eda5359d-5d91-4722-b11d-993d08a957ed","Type":"ContainerDied","Data":"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"}
Jul 17 21:27:07.677301 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.676777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d6b7c649-vbj7g" event={"ID":"eda5359d-5d91-4722-b11d-993d08a957ed","Type":"ContainerDied","Data":"d79dca949f4115621b0a28458032bfa7c2390aa4ce75a2edea691d382716b384"}
Jul 17 21:27:07.677301 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.676804    2579 scope.go:117] "RemoveContainer" containerID="ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"
Jul 17 21:27:07.685873 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.685686    2579 scope.go:117] "RemoveContainer" containerID="ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"
Jul 17 21:27:07.685971 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:27:07.685949    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81\": container with ID starting with ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81 not found: ID does not exist" containerID="ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"
Jul 17 21:27:07.686014 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.685981    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81"} err="failed to get container status \"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81\": rpc error: code = NotFound desc = could not find container \"ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81\": container with ID starting with ac4c0558aca2283082d70a046da7d7ab9945238cb08f4e822424f980b290ee81 not found: ID does not exist"
Jul 17 21:27:07.697847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.697818    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:27:07.702452 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.702426    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d6b7c649-vbj7g"]
Jul 17 21:27:07.762977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:07.762944    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda5359d-5d91-4722-b11d-993d08a957ed" path="/var/lib/kubelet/pods/eda5359d-5d91-4722-b11d-993d08a957ed/volumes"
Jul 17 21:27:28.889751 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.889713    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"]
Jul 17 21:27:28.890331 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.890305    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda5359d-5d91-4722-b11d-993d08a957ed" containerName="manager"
Jul 17 21:27:28.890422 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.890336    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda5359d-5d91-4722-b11d-993d08a957ed" containerName="manager"
Jul 17 21:27:28.890480 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.890464    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda5359d-5d91-4722-b11d-993d08a957ed" containerName="manager"
Jul 17 21:27:28.895280 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.895255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:28.897590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.897560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 21:27:28.897701 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.897612    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mcl6\""
Jul 17 21:27:28.897701 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.897618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 21:27:28.898489 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.898473    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 21:27:28.901874 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.901849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"]
Jul 17 21:27:28.978145 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.978116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsthf\" (UniqueName: \"kubernetes.io/projected/2fa1cb12-233e-4373-a14e-35c14b97e703-kube-api-access-hsthf\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:28.978145 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.978148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1cb12-233e-4373-a14e-35c14b97e703-openshift-service-ca\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:28.978365 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:28.978168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fa1cb12-233e-4373-a14e-35c14b97e703-maas-api-tls\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.079461 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.079411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsthf\" (UniqueName: \"kubernetes.io/projected/2fa1cb12-233e-4373-a14e-35c14b97e703-kube-api-access-hsthf\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.079698 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.079681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1cb12-233e-4373-a14e-35c14b97e703-openshift-service-ca\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.079834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.079817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fa1cb12-233e-4373-a14e-35c14b97e703-maas-api-tls\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.080660 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.080626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1cb12-233e-4373-a14e-35c14b97e703-openshift-service-ca\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.088225 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.083846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fa1cb12-233e-4373-a14e-35c14b97e703-maas-api-tls\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.089194 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.089142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsthf\" (UniqueName: \"kubernetes.io/projected/2fa1cb12-233e-4373-a14e-35c14b97e703-kube-api-access-hsthf\") pod \"maas-api-5b57b4884b-rldv2\" (UID: \"2fa1cb12-233e-4373-a14e-35c14b97e703\") " pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.207171 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.207075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:29.353896 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.353831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"]
Jul 17 21:27:29.356532 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:27:29.356502    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa1cb12_233e_4373_a14e_35c14b97e703.slice/crio-c7c98e195cf6060ff96fb773bff1863cc88c0a21a0db3c42361c4b3b24d431a3 WatchSource:0}: Error finding container c7c98e195cf6060ff96fb773bff1863cc88c0a21a0db3c42361c4b3b24d431a3: Status 404 returned error can't find the container with id c7c98e195cf6060ff96fb773bff1863cc88c0a21a0db3c42361c4b3b24d431a3
Jul 17 21:27:29.370935 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.370907    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"]
Jul 17 21:27:29.374326 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.374295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.376887 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.376866    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 21:27:29.382074 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.382043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5kw\" (UniqueName: \"kubernetes.io/projected/33197c48-fcc9-404f-969d-20c8c9d2c5fe-kube-api-access-gw5kw\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.382184 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.382161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33197c48-fcc9-404f-969d-20c8c9d2c5fe-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.392347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.391843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"]
Jul 17 21:27:29.407265 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.407233    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-gjnzp"]
Jul 17 21:27:29.409983 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.409966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.412466 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.412438    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pjdhp\""
Jul 17 21:27:29.421576 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.421549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-gjnzp"]
Jul 17 21:27:29.482953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.482869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5kw\" (UniqueName: \"kubernetes.io/projected/33197c48-fcc9-404f-969d-20c8c9d2c5fe-kube-api-access-gw5kw\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.482953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.482927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33197c48-fcc9-404f-969d-20c8c9d2c5fe-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.483153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.482961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2z5\" (UniqueName: \"kubernetes.io/projected/95d42920-d5b3-4726-a06c-15b23ed70ca4-kube-api-access-qs2z5\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.483153 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.483013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d42920-d5b3-4726-a06c-15b23ed70ca4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.483718 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.483700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33197c48-fcc9-404f-969d-20c8c9d2c5fe-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.495926 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.495899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5kw\" (UniqueName: \"kubernetes.io/projected/33197c48-fcc9-404f-969d-20c8c9d2c5fe-kube-api-access-gw5kw\") pod \"payload-pre-processing-7677b774bb-r8nbn\" (UID: \"33197c48-fcc9-404f-969d-20c8c9d2c5fe\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.583389 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.583358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2z5\" (UniqueName: \"kubernetes.io/projected/95d42920-d5b3-4726-a06c-15b23ed70ca4-kube-api-access-qs2z5\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.583561 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.583408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d42920-d5b3-4726-a06c-15b23ed70ca4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.584119 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.584099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d42920-d5b3-4726-a06c-15b23ed70ca4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.593096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.593071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2z5\" (UniqueName: \"kubernetes.io/projected/95d42920-d5b3-4726-a06c-15b23ed70ca4-kube-api-access-qs2z5\") pod \"payload-processing-5bf47cd988-gjnzp\" (UID: \"95d42920-d5b3-4726-a06c-15b23ed70ca4\") " pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.687233 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.687194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:29.723288 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.723256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:29.791106 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.791074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2" event={"ID":"2fa1cb12-233e-4373-a14e-35c14b97e703","Type":"ContainerStarted","Data":"c7c98e195cf6060ff96fb773bff1863cc88c0a21a0db3c42361c4b3b24d431a3"}
Jul 17 21:27:29.837536 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.837509    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"]
Jul 17 21:27:29.839744 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:27:29.839718    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33197c48_fcc9_404f_969d_20c8c9d2c5fe.slice/crio-5f3ed7c81e584118977fcf413a9cd2fa43cb5c88a0e9f097ca194568e25189fd WatchSource:0}: Error finding container 5f3ed7c81e584118977fcf413a9cd2fa43cb5c88a0e9f097ca194568e25189fd: Status 404 returned error can't find the container with id 5f3ed7c81e584118977fcf413a9cd2fa43cb5c88a0e9f097ca194568e25189fd
Jul 17 21:27:29.877308 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:29.877284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-gjnzp"]
Jul 17 21:27:29.879124 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:27:29.879097    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d42920_d5b3_4726_a06c_15b23ed70ca4.slice/crio-990a24b15c540261fbf127381cebb0e8b9ece844e38596936ef00a344640eb77 WatchSource:0}: Error finding container 990a24b15c540261fbf127381cebb0e8b9ece844e38596936ef00a344640eb77: Status 404 returned error can't find the container with id 990a24b15c540261fbf127381cebb0e8b9ece844e38596936ef00a344640eb77
Jul 17 21:27:30.800335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:30.800284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp" event={"ID":"95d42920-d5b3-4726-a06c-15b23ed70ca4","Type":"ContainerStarted","Data":"990a24b15c540261fbf127381cebb0e8b9ece844e38596936ef00a344640eb77"}
Jul 17 21:27:30.802470 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:30.802410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn" event={"ID":"33197c48-fcc9-404f-969d-20c8c9d2c5fe","Type":"ContainerStarted","Data":"5f3ed7c81e584118977fcf413a9cd2fa43cb5c88a0e9f097ca194568e25189fd"}
Jul 17 21:27:31.809916 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.809880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn" event={"ID":"33197c48-fcc9-404f-969d-20c8c9d2c5fe","Type":"ContainerStarted","Data":"14441b1b355de4faa64acfbeb8d770e7a96fd887847ebb8608c5d3d95d79b2bc"}
Jul 17 21:27:31.810298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.810048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:31.811382 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.811360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2" event={"ID":"2fa1cb12-233e-4373-a14e-35c14b97e703","Type":"ContainerStarted","Data":"a7afbcbd3e9d53dd1d5747c0bc20856c8871739d99cc805efd0bc8609bad7348"}
Jul 17 21:27:31.811464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.811424    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:31.826693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.826641    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn" podStartSLOduration=1.155690887 podStartE2EDuration="2.826626092s" totalImagesPullingTime="1.670935205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:27:31.824500568 +0000 UTC m=+618.605760295" watchObservedRunningTime="2026-07-17 21:27:31.826626092 +0000 UTC m=+618.607885810"
Jul 17 21:27:31.843482 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:31.843421    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2" podStartSLOduration=2.249811265 podStartE2EDuration="3.843399822s" totalImagesPullingTime="1.593588557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:27:31.841393264 +0000 UTC m=+618.622652984" watchObservedRunningTime="2026-07-17 21:27:31.843399822 +0000 UTC m=+618.624659551"
Jul 17 21:27:32.818130 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:32.818096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp" event={"ID":"95d42920-d5b3-4726-a06c-15b23ed70ca4","Type":"ContainerStarted","Data":"55dc3cfd10acd6949a34a55aacc24897d78b917f80e1eb9dded2c89695852b69"}
Jul 17 21:27:32.818630 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:32.818222    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:27:32.836523 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:32.836473    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp" podStartSLOduration=1.961807568 podStartE2EDuration="3.83645683s" totalImagesPullingTime="1.874649262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:27:32.835806451 +0000 UTC m=+619.617066368" watchObservedRunningTime="2026-07-17 21:27:32.83645683 +0000 UTC m=+619.617716612"
Jul 17 21:27:37.824018 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:37.823945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b57b4884b-rldv2"
Jul 17 21:27:42.821120 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:42.821087    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-r8nbn"
Jul 17 21:27:43.826984 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:27:43.826955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-gjnzp"
Jul 17 21:28:11.144066 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.144020    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"]
Jul 17 21:28:11.146895 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.146870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.150943 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.150916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z79wp\""
Jul 17 21:28:11.150943 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.150929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 21:28:11.151146 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.150917    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 21:28:11.151146 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.150918    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 21:28:11.158037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.158014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"]
Jul 17 21:28:11.179544 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.179725 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.179725 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.179725 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.179725 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cksf\" (UniqueName: \"kubernetes.io/projected/a824a899-ef43-4e7f-9afb-c3757ce2d904-kube-api-access-2cksf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.179933 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.179730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a824a899-ef43-4e7f-9afb-c3757ce2d904-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281045 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cksf\" (UniqueName: \"kubernetes.io/projected/a824a899-ef43-4e7f-9afb-c3757ce2d904-kube-api-access-2cksf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a824a899-ef43-4e7f-9afb-c3757ce2d904-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281526 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281526 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.281609 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.281581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.283637 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.283620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a824a899-ef43-4e7f-9afb-c3757ce2d904-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.283941 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.283925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a824a899-ef43-4e7f-9afb-c3757ce2d904-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.289544 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.289515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cksf\" (UniqueName: \"kubernetes.io/projected/a824a899-ef43-4e7f-9afb-c3757ce2d904-kube-api-access-2cksf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s\" (UID: \"a824a899-ef43-4e7f-9afb-c3757ce2d904\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.457805 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.457682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:11.592671 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.592647    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"]
Jul 17 21:28:11.594531 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:28:11.594500    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda824a899_ef43_4e7f_9afb_c3757ce2d904.slice/crio-9f3bec0b14e7c880ba31d75396b74a618633a71bfdf7a497e5d9758e72b410d1 WatchSource:0}: Error finding container 9f3bec0b14e7c880ba31d75396b74a618633a71bfdf7a497e5d9758e72b410d1: Status 404 returned error can't find the container with id 9f3bec0b14e7c880ba31d75396b74a618633a71bfdf7a497e5d9758e72b410d1
Jul 17 21:28:11.595887 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:11.595869    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:28:12.011511 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:12.011466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s" event={"ID":"a824a899-ef43-4e7f-9afb-c3757ce2d904","Type":"ContainerStarted","Data":"9f3bec0b14e7c880ba31d75396b74a618633a71bfdf7a497e5d9758e72b410d1"}
Jul 17 21:28:13.018937 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:13.018902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s" event={"ID":"a824a899-ef43-4e7f-9afb-c3757ce2d904","Type":"ContainerStarted","Data":"13fbfcd20039b5234a7645597cebdb872eb1e328895aeb3a0c89a60be89478e7"}
Jul 17 21:28:13.036526 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:13.036466    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s" podStartSLOduration=1.032874913 podStartE2EDuration="2.036447459s" totalImagesPullingTime="1.003572546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:28:13.03481593 +0000 UTC m=+659.816075654" watchObservedRunningTime="2026-07-17 21:28:13.036447459 +0000 UTC m=+659.817707186"
Jul 17 21:28:21.458202 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:21.458164    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:21.458720 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:21.458333    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:21.474786 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:21.471240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:28:22.074943 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:28:22.074915    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s"
Jul 17 21:29:22.319886 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.319849    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55db48f599-87w9n"]
Jul 17 21:29:22.323509 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.323489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.327074 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.327049    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 21:29:22.327205 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.327100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlptf\""
Jul 17 21:29:22.331410 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.331356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55db48f599-87w9n"]
Jul 17 21:29:22.464716 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.464684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72pkz\" (UniqueName: \"kubernetes.io/projected/b35660fe-75e2-4acb-b418-0731a6637a50-kube-api-access-72pkz\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.464935 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.464789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b35660fe-75e2-4acb-b418-0731a6637a50-tls-cert\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.566266 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.566231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72pkz\" (UniqueName: \"kubernetes.io/projected/b35660fe-75e2-4acb-b418-0731a6637a50-kube-api-access-72pkz\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.566434 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.566332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b35660fe-75e2-4acb-b418-0731a6637a50-tls-cert\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.568949 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.568931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b35660fe-75e2-4acb-b418-0731a6637a50-tls-cert\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.574502 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.574439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72pkz\" (UniqueName: \"kubernetes.io/projected/b35660fe-75e2-4acb-b418-0731a6637a50-kube-api-access-72pkz\") pod \"authorino-55db48f599-87w9n\" (UID: \"b35660fe-75e2-4acb-b418-0731a6637a50\") " pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.633439 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.633409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55db48f599-87w9n"
Jul 17 21:29:22.789411 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:22.789378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55db48f599-87w9n"]
Jul 17 21:29:22.791950 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:29:22.791918    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb35660fe_75e2_4acb_b418_0731a6637a50.slice/crio-d7b5bc5d7ab0cc566062faa411af93b4b1eca56042f60cc30999b3e95f886126 WatchSource:0}: Error finding container d7b5bc5d7ab0cc566062faa411af93b4b1eca56042f60cc30999b3e95f886126: Status 404 returned error can't find the container with id d7b5bc5d7ab0cc566062faa411af93b4b1eca56042f60cc30999b3e95f886126
Jul 17 21:29:23.368832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:23.368790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55db48f599-87w9n" event={"ID":"b35660fe-75e2-4acb-b418-0731a6637a50","Type":"ContainerStarted","Data":"8dbb9109208f3a599a496b8a701dc20c1b914c5ee288f374454aa6f1e30a65ee"}
Jul 17 21:29:23.369303 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:23.368840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55db48f599-87w9n" event={"ID":"b35660fe-75e2-4acb-b418-0731a6637a50","Type":"ContainerStarted","Data":"d7b5bc5d7ab0cc566062faa411af93b4b1eca56042f60cc30999b3e95f886126"}
Jul 17 21:29:23.385046 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:29:23.384999    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55db48f599-87w9n" podStartSLOduration=0.961646578 podStartE2EDuration="1.38498088s" totalImagesPullingTime="423.334302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:29:23.384178951 +0000 UTC m=+730.165438680" watchObservedRunningTime="2026-07-17 21:29:23.38498088 +0000 UTC m=+730.166240606"
Jul 17 21:30:08.335614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.335579    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:30:08.336242 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.335826    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" podUID="a749dfbc-b957-45dd-b18a-a8607f952345" containerName="manager" containerID="cri-o://404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2" gracePeriod=30
Jul 17 21:30:08.593249 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.593186    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:30:08.599197 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.599167    2579 generic.go:356] "Generic (PLEG): container finished" podID="a749dfbc-b957-45dd-b18a-a8607f952345" containerID="404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2" exitCode=0
Jul 17 21:30:08.599325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.599211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-c8rpn"
Jul 17 21:30:08.599325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.599239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" event={"ID":"a749dfbc-b957-45dd-b18a-a8607f952345","Type":"ContainerDied","Data":"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"}
Jul 17 21:30:08.599325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.599284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-c8rpn" event={"ID":"a749dfbc-b957-45dd-b18a-a8607f952345","Type":"ContainerDied","Data":"dc4a025dcf1e057b73c0fea8fee783859f4fb275c81c4387b45f6b8884758efc"}
Jul 17 21:30:08.599325 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.599306    2579 scope.go:117] "RemoveContainer" containerID="404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"
Jul 17 21:30:08.607956 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.607905    2579 scope.go:117] "RemoveContainer" containerID="404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"
Jul 17 21:30:08.608196 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:30:08.608178    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2\": container with ID starting with 404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2 not found: ID does not exist" containerID="404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"
Jul 17 21:30:08.608250 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.608207    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2"} err="failed to get container status \"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2\": rpc error: code = NotFound desc = could not find container \"404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2\": container with ID starting with 404789ebb9e807baa13c2b7ae58a1893c7b91de7d354d8a9df3d11f8138d09f2 not found: ID does not exist"
Jul 17 21:30:08.705096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.705064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert\") pod \"a749dfbc-b957-45dd-b18a-a8607f952345\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") "
Jul 17 21:30:08.705096 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.705101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8qvr\" (UniqueName: \"kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr\") pod \"a749dfbc-b957-45dd-b18a-a8607f952345\" (UID: \"a749dfbc-b957-45dd-b18a-a8607f952345\") "
Jul 17 21:30:08.707365 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.707335    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a749dfbc-b957-45dd-b18a-a8607f952345" (UID: "a749dfbc-b957-45dd-b18a-a8607f952345"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:30:08.707472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.707366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr" (OuterVolumeSpecName: "kube-api-access-l8qvr") pod "a749dfbc-b957-45dd-b18a-a8607f952345" (UID: "a749dfbc-b957-45dd-b18a-a8607f952345"). InnerVolumeSpecName "kube-api-access-l8qvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:30:08.806144 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.806112    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a749dfbc-b957-45dd-b18a-a8607f952345-webhook-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:30:08.806144 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.806139    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8qvr\" (UniqueName: \"kubernetes.io/projected/a749dfbc-b957-45dd-b18a-a8607f952345-kube-api-access-l8qvr\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:30:08.920621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.920586    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:30:08.924724 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:08.924697    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-c8rpn"]
Jul 17 21:30:09.763388 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:30:09.763353    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a749dfbc-b957-45dd-b18a-a8607f952345" path="/var/lib/kubelet/pods/a749dfbc-b957-45dd-b18a-a8607f952345/volumes"
Jul 17 21:31:09.706980 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.706938    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:09.707555 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.707532    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a749dfbc-b957-45dd-b18a-a8607f952345" containerName="manager"
Jul 17 21:31:09.707635 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.707561    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a749dfbc-b957-45dd-b18a-a8607f952345" containerName="manager"
Jul 17 21:31:09.707696 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.707682    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a749dfbc-b957-45dd-b18a-a8607f952345" containerName="manager"
Jul 17 21:31:09.709967 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.709946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.713196 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.713170    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5ll9z\""
Jul 17 21:31:09.713310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.713200    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:31:09.713310 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.713181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:31:09.719328 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.719306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:09.767977 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.767944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.768147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.768061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bd9m\" (UniqueName: \"kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.868623 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.868584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd9m\" (UniqueName: \"kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.868851 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.868652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.871152 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.871134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:09.877664 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:09.877628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bd9m\" (UniqueName: \"kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m\") pod \"maas-controller-bdd5689cb-vtxzt\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") " pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:10.021834 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.021800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:10.160015 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.159983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:10.162798 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:31:10.162750    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6927b44_ee02_419a_91a5_16785668edb3.slice/crio-712dc7a514e502859ce8e47f4e442307bd940fd9aeb245763f49641e8d144a43 WatchSource:0}: Error finding container 712dc7a514e502859ce8e47f4e442307bd940fd9aeb245763f49641e8d144a43: Status 404 returned error can't find the container with id 712dc7a514e502859ce8e47f4e442307bd940fd9aeb245763f49641e8d144a43
Jul 17 21:31:10.902231 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.902148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" event={"ID":"b6927b44-ee02-419a-91a5-16785668edb3","Type":"ContainerStarted","Data":"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"}
Jul 17 21:31:10.902231 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.902199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" event={"ID":"b6927b44-ee02-419a-91a5-16785668edb3","Type":"ContainerStarted","Data":"712dc7a514e502859ce8e47f4e442307bd940fd9aeb245763f49641e8d144a43"}
Jul 17 21:31:10.902644 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.902353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:10.920502 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:10.920448    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" podStartSLOduration=1.524261411 podStartE2EDuration="1.920431311s" totalImagesPullingTime="396.1699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:31:10.919271994 +0000 UTC m=+837.700531729" watchObservedRunningTime="2026-07-17 21:31:10.920431311 +0000 UTC m=+837.701691038"
Jul 17 21:31:21.909238 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:21.909203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:26.528396 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.528357    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:26.529056 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.528577    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" podUID="b6927b44-ee02-419a-91a5-16785668edb3" containerName="manager" containerID="cri-o://614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885" gracePeriod=30
Jul 17 21:31:26.781803 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.781723    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:26.935486 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.935443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert\") pod \"b6927b44-ee02-419a-91a5-16785668edb3\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") "
Jul 17 21:31:26.935687 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.935494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bd9m\" (UniqueName: \"kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m\") pod \"b6927b44-ee02-419a-91a5-16785668edb3\" (UID: \"b6927b44-ee02-419a-91a5-16785668edb3\") "
Jul 17 21:31:26.937756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.937723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m" (OuterVolumeSpecName: "kube-api-access-9bd9m") pod "b6927b44-ee02-419a-91a5-16785668edb3" (UID: "b6927b44-ee02-419a-91a5-16785668edb3"). InnerVolumeSpecName "kube-api-access-9bd9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:31:26.937900 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.937746    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b6927b44-ee02-419a-91a5-16785668edb3" (UID: "b6927b44-ee02-419a-91a5-16785668edb3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:31:26.983925 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.983889    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6927b44-ee02-419a-91a5-16785668edb3" containerID="614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885" exitCode=0
Jul 17 21:31:26.984081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.983939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-vtxzt"
Jul 17 21:31:26.984081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.983968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" event={"ID":"b6927b44-ee02-419a-91a5-16785668edb3","Type":"ContainerDied","Data":"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"}
Jul 17 21:31:26.984081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.984016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-vtxzt" event={"ID":"b6927b44-ee02-419a-91a5-16785668edb3","Type":"ContainerDied","Data":"712dc7a514e502859ce8e47f4e442307bd940fd9aeb245763f49641e8d144a43"}
Jul 17 21:31:26.984081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.984037    2579 scope.go:117] "RemoveContainer" containerID="614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"
Jul 17 21:31:26.993091 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.993075    2579 scope.go:117] "RemoveContainer" containerID="614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"
Jul 17 21:31:26.993326 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:31:26.993307    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885\": container with ID starting with 614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885 not found: ID does not exist" containerID="614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"
Jul 17 21:31:26.993375 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:26.993334    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885"} err="failed to get container status \"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885\": rpc error: code = NotFound desc = could not find container \"614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885\": container with ID starting with 614592b35e38c3c162dce0e297edff2dc3bda5abcdf52d097006e00fc843c885 not found: ID does not exist"
Jul 17 21:31:27.005217 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.005189    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:27.008534 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.008505    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-vtxzt"]
Jul 17 21:31:27.036796 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.036710    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6927b44-ee02-419a-91a5-16785668edb3-webhook-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:31:27.036796 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.036737    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bd9m\" (UniqueName: \"kubernetes.io/projected/b6927b44-ee02-419a-91a5-16785668edb3-kube-api-access-9bd9m\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:31:27.764422 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.764389    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6927b44-ee02-419a-91a5-16785668edb3" path="/var/lib/kubelet/pods/b6927b44-ee02-419a-91a5-16785668edb3/volumes"
Jul 17 21:31:27.764862 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.764647    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bdd5689cb-46fq2"]
Jul 17 21:31:27.765086 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.765070    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6927b44-ee02-419a-91a5-16785668edb3" containerName="manager"
Jul 17 21:31:27.765123 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.765088    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6927b44-ee02-419a-91a5-16785668edb3" containerName="manager"
Jul 17 21:31:27.765156 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.765152    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6927b44-ee02-419a-91a5-16785668edb3" containerName="manager"
Jul 17 21:31:27.769679 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.769658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.772322 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.772303    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:31:27.773419 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.773397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5ll9z\""
Jul 17 21:31:27.773589 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.773568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:31:27.776347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.776323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-46fq2"]
Jul 17 21:31:27.844158 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.844123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8tgl\" (UniqueName: \"kubernetes.io/projected/0e32303f-f47a-461e-9c11-2f27f3da8287-kube-api-access-l8tgl\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.844338 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.844241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32303f-f47a-461e-9c11-2f27f3da8287-webhook-cert\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.944937 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.944906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32303f-f47a-461e-9c11-2f27f3da8287-webhook-cert\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.945093 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.944978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8tgl\" (UniqueName: \"kubernetes.io/projected/0e32303f-f47a-461e-9c11-2f27f3da8287-kube-api-access-l8tgl\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.947345 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.947315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32303f-f47a-461e-9c11-2f27f3da8287-webhook-cert\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:27.953166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:27.953144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8tgl\" (UniqueName: \"kubernetes.io/projected/0e32303f-f47a-461e-9c11-2f27f3da8287-kube-api-access-l8tgl\") pod \"maas-controller-bdd5689cb-46fq2\" (UID: \"0e32303f-f47a-461e-9c11-2f27f3da8287\") " pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:28.081609 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:28.081521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:28.217068 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:28.217043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd5689cb-46fq2"]
Jul 17 21:31:28.218405 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:31:28.218381    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e32303f_f47a_461e_9c11_2f27f3da8287.slice/crio-cd01e919f752f6b945fd7f40c9f443f1d6350897b344eea24bbc38aeff054b56 WatchSource:0}: Error finding container cd01e919f752f6b945fd7f40c9f443f1d6350897b344eea24bbc38aeff054b56: Status 404 returned error can't find the container with id cd01e919f752f6b945fd7f40c9f443f1d6350897b344eea24bbc38aeff054b56
Jul 17 21:31:28.995843 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:28.995734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-46fq2" event={"ID":"0e32303f-f47a-461e-9c11-2f27f3da8287","Type":"ContainerStarted","Data":"46243a147d3572edfda0a59e754169b49291465258fb20c0fe0d4ef3723073c0"}
Jul 17 21:31:28.995843 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:28.995820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:31:28.996226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:28.995845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd5689cb-46fq2" event={"ID":"0e32303f-f47a-461e-9c11-2f27f3da8287","Type":"ContainerStarted","Data":"cd01e919f752f6b945fd7f40c9f443f1d6350897b344eea24bbc38aeff054b56"}
Jul 17 21:31:29.021624 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:29.021572    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bdd5689cb-46fq2" podStartSLOduration=1.715715425 podStartE2EDuration="2.021555082s" totalImagesPullingTime="305.839657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:31:29.021087681 +0000 UTC m=+855.802347420" watchObservedRunningTime="2026-07-17 21:31:29.021555082 +0000 UTC m=+855.802814835"
Jul 17 21:31:40.002980 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:31:40.002951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bdd5689cb-46fq2"
Jul 17 21:43:35.023151 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.023111    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:43:35.027239 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.027217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.029881 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.029856    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ddd2a457-serving-cert\""
Jul 17 21:43:35.036993 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.036971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:43:35.139493 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.139456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.139672 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.139533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zrr\" (UniqueName: \"kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.139672 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.139630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.240750 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.240713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.240951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.240791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.240951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.240890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zrr\" (UniqueName: \"kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.240951 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:35.240891    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-serving-cert: secret "maas-api-e2e-ait-ddd2a457-serving-cert" not found
Jul 17 21:43:35.241060 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:35.240993    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls podName:7a1bb6e6-b86f-488b-aa80-baeee4f7efcb nodeName:}" failed. No retries permitted until 2026-07-17 21:43:35.740975775 +0000 UTC m=+1582.522235480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls") pod "maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" (UID: "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb") : secret "maas-api-e2e-ait-ddd2a457-serving-cert" not found
Jul 17 21:43:35.241517 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.241495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.257655 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.257629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zrr\" (UniqueName: \"kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.746492 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.746461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.748959 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.748932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") pod \"maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:35.939656 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:35.939618    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:36.088643 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:36.088617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:43:36.090971 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:43:36.090944    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1bb6e6_b86f_488b_aa80_baeee4f7efcb.slice/crio-ea05d09bbb2709289e9919f2b939c4772a36168b4f885613e82ae252d5cf1dea WatchSource:0}: Error finding container ea05d09bbb2709289e9919f2b939c4772a36168b4f885613e82ae252d5cf1dea: Status 404 returned error can't find the container with id ea05d09bbb2709289e9919f2b939c4772a36168b4f885613e82ae252d5cf1dea
Jul 17 21:43:36.092398 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:36.092382    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:43:36.683061 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:36.683028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerStarted","Data":"ea05d09bbb2709289e9919f2b939c4772a36168b4f885613e82ae252d5cf1dea"}
Jul 17 21:43:37.690288 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:37.690254    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="bbddf01c81392ccc4bf19688dd38d335119e1c650a944b75ccb4ac76b12431cd" exitCode=1
Jul 17 21:43:37.690681 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:37.690304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"bbddf01c81392ccc4bf19688dd38d335119e1c650a944b75ccb4ac76b12431cd"}
Jul 17 21:43:37.690681 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:37.690584    2579 scope.go:117] "RemoveContainer" containerID="bbddf01c81392ccc4bf19688dd38d335119e1c650a944b75ccb4ac76b12431cd"
Jul 17 21:43:38.697530 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:38.697434    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697" exitCode=1
Jul 17 21:43:38.697530 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:38.697520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"}
Jul 17 21:43:38.698000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:38.697572    2579 scope.go:117] "RemoveContainer" containerID="bbddf01c81392ccc4bf19688dd38d335119e1c650a944b75ccb4ac76b12431cd"
Jul 17 21:43:38.698000 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:38.697838    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:38.698088 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:38.698029    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:43:39.704433 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:39.704404    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:39.704829 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:39.704589    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:43:40.940029 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:40.939993    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:40.940403 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:40.940362    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:40.940563 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:40.940543    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:43:45.940134 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:45.940099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:43:45.940500 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:45.940486    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:45.940675 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:45.940656    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:43:57.767943 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:57.767911    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:58.806847 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:58.806815    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9" exitCode=1
Jul 17 21:43:58.807247 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:58.806855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"}
Jul 17 21:43:58.807247 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:58.806902    2579 scope.go:117] "RemoveContainer" containerID="1e42f6bcb2815087db3955de12ad42c4326c43e302c78322f49cd9ceec0d4697"
Jul 17 21:43:58.807247 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:43:58.807219    2579 scope.go:117] "RemoveContainer" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"
Jul 17 21:43:58.807433 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:43:58.807415    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:00.940706 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:00.940678    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:44:00.941088 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:00.941013    2579 scope.go:117] "RemoveContainer" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"
Jul 17 21:44:00.941228 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:00.941208    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:05.940588 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:05.940505    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:44:05.941085 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:05.940965    2579 scope.go:117] "RemoveContainer" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"
Jul 17 21:44:05.941193 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:05.941167    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:18.756974 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:18.756940    2579 scope.go:117] "RemoveContainer" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"
Jul 17 21:44:19.916715 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:19.916629    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959" exitCode=1
Jul 17 21:44:19.917148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:19.916705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"}
Jul 17 21:44:19.917148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:19.916780    2579 scope.go:117] "RemoveContainer" containerID="a7e7bbf4257db221b0e20764ad806a357c910f761aa433cbd8f1957cfb4432a9"
Jul 17 21:44:19.917148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:19.917125    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:44:19.917365 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:19.917346    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:20.939779 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:20.939732    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:44:20.940178 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:20.940153    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:44:20.940350 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:20.940331    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:25.940286 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:25.940246    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:44:25.940754 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:25.940684    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:44:25.940994 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:25.940967    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:39.756922 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:39.756890    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:44:39.757389 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:39.757060    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:44:52.756685 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:44:52.756651    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:44:52.757079 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:44:52.756877    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:05.757332 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:05.757296    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:45:07.156157 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:07.156123    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f" exitCode=1
Jul 17 21:45:07.156581 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:07.156168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"}
Jul 17 21:45:07.156581 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:07.156227    2579 scope.go:117] "RemoveContainer" containerID="9f82eee67104d6cce49b686f23861d2769b6b2243c4615f2090d3c19c82a5959"
Jul 17 21:45:07.156666 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:07.156589    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:07.156885 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:07.156864    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:10.940037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:10.940009    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:45:10.940498 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:10.940396    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:10.940588 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:10.940568    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:15.940164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:15.940131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:45:15.940634 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:15.940616    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:15.940845 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:15.940823    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:28.757404 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:28.757370    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:28.757835 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:28.757574    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:43.759069 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:43.759038    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:43.759534 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:43.759318    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:45:57.757088 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:45:57.757057    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:45:57.757459 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:45:57.757251    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:46:09.756953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:09.756923    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:46:09.757317 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:09.757110    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:46:22.756869 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:22.756841    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:46:22.757361 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:22.757040    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:46:33.759650 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:33.759617    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:46:34.591092 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:34.591057    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerID="b1458c0f8ecade5ecf9a9467b022dae036420192b85151a2f3995fa1cb67130a" exitCode=1
Jul 17 21:46:34.591244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:34.591124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"b1458c0f8ecade5ecf9a9467b022dae036420192b85151a2f3995fa1cb67130a"}
Jul 17 21:46:34.591244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:34.591187    2579 scope.go:117] "RemoveContainer" containerID="efc5250c102fb133cea90fd79ca084cebd38487e3c7699d04559d5529a7eb27f"
Jul 17 21:46:34.591567 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:34.591545    2579 scope.go:117] "RemoveContainer" containerID="b1458c0f8ecade5ecf9a9467b022dae036420192b85151a2f3995fa1cb67130a"
Jul 17 21:46:34.591838 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:34.591814    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:46:35.940066 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:35.940023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:46:35.940472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:35.940099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:46:35.940472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:35.940438    2579 scope.go:117] "RemoveContainer" containerID="b1458c0f8ecade5ecf9a9467b022dae036420192b85151a2f3995fa1cb67130a"
Jul 17 21:46:35.940620 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:35.940602    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h_odh-ai-gateway-infra(7a1bb6e6-b86f-488b-aa80-baeee4f7efcb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"
Jul 17 21:46:45.231576 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.231536    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:46:45.367236 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.367211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:46:45.459212 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.459126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca\") pod \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") "
Jul 17 21:46:45.459367 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.459232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") pod \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") "
Jul 17 21:46:45.459367 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.459263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8zrr\" (UniqueName: \"kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr\") pod \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\" (UID: \"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb\") "
Jul 17 21:46:45.459590 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.459544    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" (UID: "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:46:45.461622 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.461589    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" (UID: "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:46:45.461743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.461646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr" (OuterVolumeSpecName: "kube-api-access-v8zrr") pod "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" (UID: "7a1bb6e6-b86f-488b-aa80-baeee4f7efcb"). InnerVolumeSpecName "kube-api-access-v8zrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:46:45.560415 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.560377    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:46:45.560415 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.560410    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8zrr\" (UniqueName: \"kubernetes.io/projected/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-kube-api-access-v8zrr\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:46:45.560415 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.560419    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:46:45.649422 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.649387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h" event={"ID":"7a1bb6e6-b86f-488b-aa80-baeee4f7efcb","Type":"ContainerDied","Data":"ea05d09bbb2709289e9919f2b939c4772a36168b4f885613e82ae252d5cf1dea"}
Jul 17 21:46:45.649616 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.649426    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"
Jul 17 21:46:45.649616 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.649446    2579 scope.go:117] "RemoveContainer" containerID="b1458c0f8ecade5ecf9a9467b022dae036420192b85151a2f3995fa1cb67130a"
Jul 17 21:46:45.672856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.672826    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:46:45.674807 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.674782    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ddd2a457-7d758858d6-mt76h"]
Jul 17 21:46:45.763601 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:45.763572    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" path="/var/lib/kubelet/pods/7a1bb6e6-b86f-488b-aa80-baeee4f7efcb/volumes"
Jul 17 21:46:53.665270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:46:53.665699 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665682    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665702    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665710    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665716    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665722    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665744 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665728    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665828    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665839    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665847    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665856    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.665950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.665865    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:46:53.670858 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.670836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.673019 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.672989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-da1f2be7-serving-cert\""
Jul 17 21:46:53.679789 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.679737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:46:53.838861 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.838826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.839066 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.838949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.839066 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.838982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9cv\" (UniqueName: \"kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.940231 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.940147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.940231 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.940184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9cv\" (UniqueName: \"kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.940410 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.940253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.940876 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.940849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.942681 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.942660    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.952071 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.952039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9cv\" (UniqueName: \"kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv\") pod \"maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:53.982114 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:53.982075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:54.130114 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:54.130087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:46:54.133077 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:46:54.133042    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7919837c_5439_43f2_835b_08104a4b030f.slice/crio-dd6c05086575067f5702cde998cb6f87d6225cedec23489bfe13acc8ef29bfdd WatchSource:0}: Error finding container dd6c05086575067f5702cde998cb6f87d6225cedec23489bfe13acc8ef29bfdd: Status 404 returned error can't find the container with id dd6c05086575067f5702cde998cb6f87d6225cedec23489bfe13acc8ef29bfdd
Jul 17 21:46:54.700818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:54.700782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerStarted","Data":"093fbba270ce39129cad7cc98b6e50d68264f0d3e4b3840a7ae373c3423b52ed"}
Jul 17 21:46:54.701257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:54.700842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerStarted","Data":"dd6c05086575067f5702cde998cb6f87d6225cedec23489bfe13acc8ef29bfdd"}
Jul 17 21:46:54.701257 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:54.700889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:54.718302 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:54.718247    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podStartSLOduration=1.322672342 podStartE2EDuration="1.71823309s" totalImagesPullingTime="395.560748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:54.716575338 +0000 UTC m=+1781.497835073" watchObservedRunningTime="2026-07-17 21:46:54.71823309 +0000 UTC m=+1781.499492817"
Jul 17 21:46:55.707476 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:55.707441    2579 generic.go:356] "Generic (PLEG): container finished" podID="7919837c-5439-43f2-835b-08104a4b030f" containerID="093fbba270ce39129cad7cc98b6e50d68264f0d3e4b3840a7ae373c3423b52ed" exitCode=1
Jul 17 21:46:55.707856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:55.707536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerDied","Data":"093fbba270ce39129cad7cc98b6e50d68264f0d3e4b3840a7ae373c3423b52ed"}
Jul 17 21:46:55.707856 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:55.707759    2579 scope.go:117] "RemoveContainer" containerID="093fbba270ce39129cad7cc98b6e50d68264f0d3e4b3840a7ae373c3423b52ed"
Jul 17 21:46:56.715139 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:56.715052    2579 generic.go:356] "Generic (PLEG): container finished" podID="7919837c-5439-43f2-835b-08104a4b030f" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41" exitCode=1
Jul 17 21:46:56.715587 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:56.715143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerDied","Data":"d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"}
Jul 17 21:46:56.715587 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:56.715208    2579 scope.go:117] "RemoveContainer" containerID="093fbba270ce39129cad7cc98b6e50d68264f0d3e4b3840a7ae373c3423b52ed"
Jul 17 21:46:56.722366 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:56.715909    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:46:56.722366 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:56.716293    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:46:57.722166 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:57.722133    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:46:57.722552 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:57.722347    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:46:59.701793 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:59.701727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:46:59.702168 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:46:59.702142    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:46:59.702331 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:46:59.702303    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:03.983229 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:03.983140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:47:03.983631 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:03.983589    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:47:03.983842 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:03.983813    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:18.756951 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:18.756914    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:47:19.840379 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:19.840345    2579 generic.go:356] "Generic (PLEG): container finished" podID="7919837c-5439-43f2-835b-08104a4b030f" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667" exitCode=1
Jul 17 21:47:19.840808 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:19.840418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerDied","Data":"72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"}
Jul 17 21:47:19.840808 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:19.840488    2579 scope.go:117] "RemoveContainer" containerID="d29ffe6b14c14ba6a4df3db74022863616db398a2b5079f9b0f6bc4ce48ecd41"
Jul 17 21:47:19.840927 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:19.840897    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:19.841151 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:19.841127    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:23.982898 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:23.982863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:47:23.983356 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:23.983286    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:23.983493 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:23.983473    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:24.701195 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:24.701156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:47:24.867141 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:24.867113    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:24.867321 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:24.867302    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:38.757239 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:38.757205    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:38.757700 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:38.757412    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:51.757041 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:51.757013    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:53.006125 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:53.006038    2579 generic.go:356] "Generic (PLEG): container finished" podID="7919837c-5439-43f2-835b-08104a4b030f" containerID="b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186" exitCode=1
Jul 17 21:47:53.006125 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:53.006106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerDied","Data":"b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186"}
Jul 17 21:47:53.006592 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:53.006197    2579 scope.go:117] "RemoveContainer" containerID="72ba6e1de06bc3e73f87389d3e04971a2294dce2507065232c5cec9523c45667"
Jul 17 21:47:53.006642 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:53.006618    2579 scope.go:117] "RemoveContainer" containerID="b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186"
Jul 17 21:47:53.006842 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:53.006825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:53.982357 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:53.982323    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:47:54.012965 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:54.012934    2579 scope.go:117] "RemoveContainer" containerID="b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186"
Jul 17 21:47:54.013425 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:54.013174    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:47:54.701833 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:54.701799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:47:55.017861 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:47:55.017837    2579 scope.go:117] "RemoveContainer" containerID="b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186"
Jul 17 21:47:55.018219 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:47:55.018047    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg_odh-ai-gateway-infra(7919837c-5439-43f2-835b-08104a4b030f)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" podUID="7919837c-5439-43f2-835b-08104a4b030f"
Jul 17 21:48:03.942987 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:03.942952    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:48:04.082296 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.082269    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:48:04.220366 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.220285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca\") pod \"7919837c-5439-43f2-835b-08104a4b030f\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") "
Jul 17 21:48:04.220522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.220412    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls\") pod \"7919837c-5439-43f2-835b-08104a4b030f\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") "
Jul 17 21:48:04.220522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.220430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht9cv\" (UniqueName: \"kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv\") pod \"7919837c-5439-43f2-835b-08104a4b030f\" (UID: \"7919837c-5439-43f2-835b-08104a4b030f\") "
Jul 17 21:48:04.220743 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.220707    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7919837c-5439-43f2-835b-08104a4b030f" (UID: "7919837c-5439-43f2-835b-08104a4b030f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:48:04.222619 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.222589    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7919837c-5439-43f2-835b-08104a4b030f" (UID: "7919837c-5439-43f2-835b-08104a4b030f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:48:04.222788 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.222746    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv" (OuterVolumeSpecName: "kube-api-access-ht9cv") pod "7919837c-5439-43f2-835b-08104a4b030f" (UID: "7919837c-5439-43f2-835b-08104a4b030f"). InnerVolumeSpecName "kube-api-access-ht9cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:48:04.321522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.321485    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7919837c-5439-43f2-835b-08104a4b030f-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:48:04.321522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.321520    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht9cv\" (UniqueName: \"kubernetes.io/projected/7919837c-5439-43f2-835b-08104a4b030f-kube-api-access-ht9cv\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:48:04.321522 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:04.321530    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7919837c-5439-43f2-835b-08104a4b030f-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:48:05.068102 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.068065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg" event={"ID":"7919837c-5439-43f2-835b-08104a4b030f","Type":"ContainerDied","Data":"dd6c05086575067f5702cde998cb6f87d6225cedec23489bfe13acc8ef29bfdd"}
Jul 17 21:48:05.068562 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.068107    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"
Jul 17 21:48:05.068562 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.068126    2579 scope.go:117] "RemoveContainer" containerID="b12d0dccd3dcf0705b3652de1345d41a4183b3b1857dafb12880745c27365186"
Jul 17 21:48:05.096109 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.096075    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:48:05.101441 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.101414    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da1f2be7-78f769d56-lv2vg"]
Jul 17 21:48:05.762647 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:05.762602    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7919837c-5439-43f2-835b-08104a4b030f" path="/var/lib/kubelet/pods/7919837c-5439-43f2-835b-08104a4b030f/volumes"
Jul 17 21:48:12.365571 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.365532    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:48:12.365987 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.365972    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.365989    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.365997    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366003    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366008    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366013    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366017    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366022    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366030 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366030    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366035    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366103    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366112    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366118    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366124    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.366264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.366130    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:48:12.370264 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.370247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.372836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.372816    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b3d03bc3-serving-cert\""
Jul 17 21:48:12.380989 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.380968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:48:12.501627 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.501589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.501853 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.501633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.501853 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.501659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48xc\" (UniqueName: \"kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.602556 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.602513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.602734 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.602566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.602734 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.602600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z48xc\" (UniqueName: \"kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.602734 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:12.602674    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-serving-cert: secret "maas-api-e2e-ait-b3d03bc3-serving-cert" not found
Jul 17 21:48:12.602873 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:12.602742    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls podName:094c099e-85ad-45a7-bc79-671a5f520124 nodeName:}" failed. No retries permitted until 2026-07-17 21:48:13.102719182 +0000 UTC m=+1859.883978887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls") pod "maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" (UID: "094c099e-85ad-45a7-bc79-671a5f520124") : secret "maas-api-e2e-ait-b3d03bc3-serving-cert" not found
Jul 17 21:48:12.603348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.603324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:12.612283 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:12.612259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48xc\" (UniqueName: \"kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:13.108283 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:13.108246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:13.110843 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:13.110816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") pod \"maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:13.281010 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:13.280960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:13.429134 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:13.429109    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:48:13.430951 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:48:13.430916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094c099e_85ad_45a7_bc79_671a5f520124.slice/crio-34deffece2dfd262c9e402a5b04e934c3b04667174125a48550fad65836246be WatchSource:0}: Error finding container 34deffece2dfd262c9e402a5b04e934c3b04667174125a48550fad65836246be: Status 404 returned error can't find the container with id 34deffece2dfd262c9e402a5b04e934c3b04667174125a48550fad65836246be
Jul 17 21:48:14.114304 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:14.114210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerStarted","Data":"dfd206312b30420414656c03bdd914b8e649217a5be7b34717f49d1014794e96"}
Jul 17 21:48:14.114304 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:14.114302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerStarted","Data":"34deffece2dfd262c9e402a5b04e934c3b04667174125a48550fad65836246be"}
Jul 17 21:48:14.114487 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:14.114334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:14.139920 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:14.139867    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podStartSLOduration=1.7949985179999999 podStartE2EDuration="2.139852193s" totalImagesPullingTime="344.853675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:48:14.138837265 +0000 UTC m=+1860.920096993" watchObservedRunningTime="2026-07-17 21:48:14.139852193 +0000 UTC m=+1860.921111920"
Jul 17 21:48:15.120650 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:15.120615    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="dfd206312b30420414656c03bdd914b8e649217a5be7b34717f49d1014794e96" exitCode=1
Jul 17 21:48:15.121054 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:15.120706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"dfd206312b30420414656c03bdd914b8e649217a5be7b34717f49d1014794e96"}
Jul 17 21:48:15.121054 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:15.120961    2579 scope.go:117] "RemoveContainer" containerID="dfd206312b30420414656c03bdd914b8e649217a5be7b34717f49d1014794e96"
Jul 17 21:48:16.127343 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:16.127258    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf" exitCode=1
Jul 17 21:48:16.127719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:16.127345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"}
Jul 17 21:48:16.127719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:16.127419    2579 scope.go:117] "RemoveContainer" containerID="dfd206312b30420414656c03bdd914b8e649217a5be7b34717f49d1014794e96"
Jul 17 21:48:16.127719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:16.127689    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:16.127935 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:16.127915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:17.134095 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:17.134063    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:17.134493 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:17.134338    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:19.114576 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:19.114540    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:19.115002 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:19.114987    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:19.115200 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:19.115180    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:23.282029 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:23.281997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:23.282472 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:23.282388    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:23.282587 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:23.282567    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:36.757478 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:36.757445    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:36.759997 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:36.757871    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:48:38.239220 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:38.239190    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535" exitCode=1
Jul 17 21:48:38.239621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:38.239251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"}
Jul 17 21:48:38.239621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:38.239299    2579 scope.go:117] "RemoveContainer" containerID="1898b99194aa25ade7b397fafd6195ce787bf2b59d24c6c34f776b51facb07cf"
Jul 17 21:48:38.239756 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:38.239622    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:48:38.239895 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:38.239875    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:39.115108 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:39.115064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:39.246523 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:39.246483    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:48:39.246943 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:39.246687    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:43.282027 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:43.281992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:48:43.282436 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:43.282409    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:48:43.282619 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:43.282595    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:48:53.759371 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:48:53.759342    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:48:53.759783 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:48:53.759548    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:04.757636 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:04.757595    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:49:05.375557 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:05.375522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerStarted","Data":"ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"}
Jul 17 21:49:05.375759 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:05.375734    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:49:06.382193 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:06.382161    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590" exitCode=1
Jul 17 21:49:06.382695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:06.382247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"}
Jul 17 21:49:06.382695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:06.382318    2579 scope.go:117] "RemoveContainer" containerID="1f692d116a5c67f30865df376ce5878a1dcb87a217894c16a20a566f545fd535"
Jul 17 21:49:06.382695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:06.382620    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:06.382860 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:06.382833    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:07.388838 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:07.388809    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:07.389323 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:07.389048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:13.282027 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:13.281983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:49:13.282454 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:13.282438    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:13.282647 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:13.282628    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:24.757124 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:24.757087    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:24.757502 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:24.757263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:38.756465 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:38.756432    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:38.757073 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:38.756624    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:50.756802 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:50.756756    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:51.605649 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:51.605616    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022" exitCode=1
Jul 17 21:49:51.605848 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:51.605693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"}
Jul 17 21:49:51.605848 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:51.605755    2579 scope.go:117] "RemoveContainer" containerID="ae59dc0d9c00b4d15d739d6867a28b55a1bad678889b563cc790f141b555f590"
Jul 17 21:49:51.606115 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:51.606095    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:49:51.606326 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:51.606296    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:53.281147 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:53.281116    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:49:53.281532 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:53.281473    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:49:53.281670 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:53.281651    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:49:55.376617 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:55.376584    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:49:55.377028 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:49:55.377011    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:49:55.377211 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:49:55.377190    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:50:10.757021 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:50:10.756935    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:50:10.757481 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:50:10.757133    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:50:21.756693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:50:21.756662    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:50:21.757125 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:50:21.756902    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:50:34.756868 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:50:34.756829    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:50:34.757337 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:50:34.757007    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:50:47.757003 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:50:47.756970    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:50:47.757450 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:50:47.757180    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:00.757520 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:00.757486    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:51:00.758005 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:00.757653    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:15.757276 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:15.757244    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:51:17.033602 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:17.033566    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0" exitCode=1
Jul 17 21:51:17.034037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:17.033654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"}
Jul 17 21:51:17.034037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:17.033738    2579 scope.go:117] "RemoveContainer" containerID="37c794d76825b89aabdd03d0146ff1c6ea1368f1b8082d9e764adce59aca7022"
Jul 17 21:51:17.034164 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:17.034082    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:51:17.034324 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:17.034300    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:20.376126 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:20.376088    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:51:20.376502 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:20.376484    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:51:20.376715 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:20.376694    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:23.281849 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:23.281800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:51:23.282337 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:23.282163    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:51:23.282381 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:23.282335    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:37.757448 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:37.757373    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:51:37.757905 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:37.757571    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:51:51.756982 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:51:51.756943    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:51:51.757542 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:51:51.757145    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:52:03.759329 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:52:03.759295    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:52:03.759808 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:52:03.759492    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:52:14.757750 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:52:14.757722    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:52:14.758255 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:52:14.757920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:52:27.763128 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:52:27.763092    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:52:27.763509 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:52:27.763304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:52:41.757066 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:52:41.757035    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:52:41.757468 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:52:41.757198    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:52:53.760336 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:52:53.760299    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:52:53.760843 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:52:53.760556    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:53:08.757347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:53:08.757262    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:53:08.757867 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:53:08.757479    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:53:23.759108 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:53:23.759069    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:53:23.759572 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:53:23.759349    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:53:34.757475 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:53:34.757443    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:53:34.757886 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:53:34.757629    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:53:49.757607 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:53:49.757570    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:53:49.758066 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:53:49.757844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:54:04.757464 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:04.757429    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:54:04.757886 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:04.757786    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:54:05.880298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:05.880211    2579 generic.go:356] "Generic (PLEG): container finished" podID="094c099e-85ad-45a7-bc79-671a5f520124" containerID="4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4" exitCode=1
Jul 17 21:54:05.880298 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:05.880278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4"}
Jul 17 21:54:05.880759 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:05.880336    2579 scope.go:117] "RemoveContainer" containerID="52fcdeda658fe85210987f186e331c1dcf8ce032f574cda231dabd26f59c09e0"
Jul 17 21:54:05.880836 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:05.880795    2579 scope.go:117] "RemoveContainer" containerID="4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4"
Jul 17 21:54:05.881073 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:05.881049    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:54:10.376508 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:10.376469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:54:10.376928 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:10.376894    2579 scope.go:117] "RemoveContainer" containerID="4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4"
Jul 17 21:54:10.377102 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:10.377082    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:54:13.282140 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:13.282103    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:54:13.282557 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:13.282541    2579 scope.go:117] "RemoveContainer" containerID="4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4"
Jul 17 21:54:13.282815 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:13.282787    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s_odh-ai-gateway-infra(094c099e-85ad-45a7-bc79-671a5f520124)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" podUID="094c099e-85ad-45a7-bc79-671a5f520124"
Jul 17 21:54:22.565244 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.565208    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:54:22.715126 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.715098    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:54:22.797919 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.797886    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48xc\" (UniqueName: \"kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc\") pod \"094c099e-85ad-45a7-bc79-671a5f520124\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") "
Jul 17 21:54:22.798099 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.797932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca\") pod \"094c099e-85ad-45a7-bc79-671a5f520124\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") "
Jul 17 21:54:22.798099 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.798088    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") pod \"094c099e-85ad-45a7-bc79-671a5f520124\" (UID: \"094c099e-85ad-45a7-bc79-671a5f520124\") "
Jul 17 21:54:22.798350 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.798324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "094c099e-85ad-45a7-bc79-671a5f520124" (UID: "094c099e-85ad-45a7-bc79-671a5f520124"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:54:22.800253 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.800221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "094c099e-85ad-45a7-bc79-671a5f520124" (UID: "094c099e-85ad-45a7-bc79-671a5f520124"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:54:22.800253 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.800240    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc" (OuterVolumeSpecName: "kube-api-access-z48xc") pod "094c099e-85ad-45a7-bc79-671a5f520124" (UID: "094c099e-85ad-45a7-bc79-671a5f520124"). InnerVolumeSpecName "kube-api-access-z48xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:54:22.899280 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.899197    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/094c099e-85ad-45a7-bc79-671a5f520124-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:54:22.899280 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.899227    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48xc\" (UniqueName: \"kubernetes.io/projected/094c099e-85ad-45a7-bc79-671a5f520124-kube-api-access-z48xc\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:54:22.899280 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.899236    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/094c099e-85ad-45a7-bc79-671a5f520124-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:54:22.966659 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.966619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s" event={"ID":"094c099e-85ad-45a7-bc79-671a5f520124","Type":"ContainerDied","Data":"34deffece2dfd262c9e402a5b04e934c3b04667174125a48550fad65836246be"}
Jul 17 21:54:22.966659 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.966638    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"
Jul 17 21:54:22.966897 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.966685    2579 scope.go:117] "RemoveContainer" containerID="4988772f7d98d2807ed76d3548f5658922fa34b8a8aeefae5bf70159eaefefc4"
Jul 17 21:54:22.988379 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.988351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:54:22.992655 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:22.992631    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3d03bc3-66bdcd85f7-fll7s"]
Jul 17 21:54:23.764335 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:23.764300    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="094c099e-85ad-45a7-bc79-671a5f520124" path="/var/lib/kubelet/pods/094c099e-85ad-45a7-bc79-671a5f520124/volumes"
Jul 17 21:54:30.762269 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762228    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:54:30.762719 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762704    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762723    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762738    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762743    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762753    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762759    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762781    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762789    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762801    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762807    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762812    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.762818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762817    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762834    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762839    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1bb6e6-b86f-488b-aa80-baeee4f7efcb" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762847    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762852    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7919837c-5439-43f2-835b-08104a4b030f" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762930    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762938    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762947    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762960    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.763200 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.762968    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:54:30.767347 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.767327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.769950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.769928    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-24f6a20e-serving-cert\""
Jul 17 21:54:30.778952 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.778915    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:54:30.873832 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.873760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.874012 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.873890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrzd\" (UniqueName: \"kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.874012 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.873911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.974781 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.974727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrzd\" (UniqueName: \"kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.974953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.974791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.974953 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.974888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.975520 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.975499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.977267 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.977238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:30.992033 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:30.992007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrzd\" (UniqueName: \"kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd\") pod \"maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:31.078921 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:31.078883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:31.235254 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:31.235230    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:54:31.237696 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:54:31.237658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39787f18_682c_463a_a6ae_23a3f4f19063.slice/crio-fd103a6078bd639ec862f4f57fa532ffe339a1105c4a37f01a5c9feefbe92cf5 WatchSource:0}: Error finding container fd103a6078bd639ec862f4f57fa532ffe339a1105c4a37f01a5c9feefbe92cf5: Status 404 returned error can't find the container with id fd103a6078bd639ec862f4f57fa532ffe339a1105c4a37f01a5c9feefbe92cf5
Jul 17 21:54:32.019060 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:32.019029    2579 generic.go:356] "Generic (PLEG): container finished" podID="39787f18-682c-463a-a6ae-23a3f4f19063" containerID="ebe7d2d1d861ad2ffa3db77b53c80daa21bdf1a60f137655ec2efe9888afcd8c" exitCode=1
Jul 17 21:54:32.019381 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:32.019116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"ebe7d2d1d861ad2ffa3db77b53c80daa21bdf1a60f137655ec2efe9888afcd8c"}
Jul 17 21:54:32.019381 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:32.019191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerStarted","Data":"fd103a6078bd639ec862f4f57fa532ffe339a1105c4a37f01a5c9feefbe92cf5"}
Jul 17 21:54:32.019450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:32.019386    2579 scope.go:117] "RemoveContainer" containerID="ebe7d2d1d861ad2ffa3db77b53c80daa21bdf1a60f137655ec2efe9888afcd8c"
Jul 17 21:54:33.026700 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:33.026667    2579 generic.go:356] "Generic (PLEG): container finished" podID="39787f18-682c-463a-a6ae-23a3f4f19063" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992" exitCode=1
Jul 17 21:54:33.027188 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:33.026748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"}
Jul 17 21:54:33.027188 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:33.026812    2579 scope.go:117] "RemoveContainer" containerID="ebe7d2d1d861ad2ffa3db77b53c80daa21bdf1a60f137655ec2efe9888afcd8c"
Jul 17 21:54:33.027188 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:33.027105    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:33.027399 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:33.027377    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:54:34.034092 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:34.034017    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:34.034483 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:34.034199    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:54:36.079621 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:36.079588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:36.080037 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:36.080021    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:36.080210 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:36.080191    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:54:41.079383 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:41.079352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:41.079782 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:41.079736    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:41.079956 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:41.079936    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:54:53.759471 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:53.759440    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:55.139695 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:55.139658    2579 generic.go:356] "Generic (PLEG): container finished" podID="39787f18-682c-463a-a6ae-23a3f4f19063" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b" exitCode=1
Jul 17 21:54:55.140159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:55.139729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"}
Jul 17 21:54:55.140159 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:55.139835    2579 scope.go:117] "RemoveContainer" containerID="b70d88c31cb32fb315c9b3f8a474821e5ce414d2ad0800ecf5ff8fbfab3c8992"
Jul 17 21:54:55.140274 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:55.140261    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:54:55.140476 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:55.140458    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:54:56.079348 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:56.079309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:54:56.146843 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:54:56.146815    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:54:56.147311 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:54:56.147098    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:01.080003 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:01.079971    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:55:01.080371 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:01.080325    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:55:01.080539 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:01.080517    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:12.756703 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:12.756668    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:55:12.757132 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:12.756862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:23.759297 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:23.759258    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:55:25.296235 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:25.296197    2579 generic.go:356] "Generic (PLEG): container finished" podID="39787f18-682c-463a-a6ae-23a3f4f19063" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f" exitCode=1
Jul 17 21:55:25.296235 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:25.296240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"}
Jul 17 21:55:25.296820 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:25.296289    2579 scope.go:117] "RemoveContainer" containerID="d4448fef422f30856deb72b176aff852a716adb140e3a271c419baf65ef1ac1b"
Jul 17 21:55:25.296820 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:25.296714    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:55:25.296978 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:25.296955    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:26.079300 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:26.079264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:55:26.302589 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:26.302556    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:55:26.303006 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:26.302761    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:31.079018 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:31.078987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:55:31.079437 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:31.079421    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:55:31.079631 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:31.079610    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:41.757594 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:41.757557    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:55:41.758007 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:41.757881    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:55:56.757035 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:55:56.756991    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:55:56.757622 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:55:56.757293    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:56:08.756910 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:08.756832    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:56:09.527659 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:09.527617    2579 generic.go:356] "Generic (PLEG): container finished" podID="39787f18-682c-463a-a6ae-23a3f4f19063" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd" exitCode=1
Jul 17 21:56:09.527850 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:09.527690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"}
Jul 17 21:56:09.527850 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:09.527760    2579 scope.go:117] "RemoveContainer" containerID="b4e60b311586d8a2a901cf7028d2a108aafcbcc414f8c74a6de3ceeb36a02e9f"
Jul 17 21:56:09.528173 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:09.528153    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:56:09.528366 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:56:09.528347    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:56:11.079400 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:11.079366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:56:11.079796 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:11.079426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:56:11.079796 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:11.079784    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:56:11.079982 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:56:11.079962    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:56:22.757616 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:22.757589    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:56:22.758007 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:56:22.757721    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:56:37.757189 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:37.757160    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:56:37.757660 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:56:37.757345    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:56:48.757450 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:56:48.757415    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:56:48.757871 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:56:48.757640    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:57:00.756667 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:00.756622    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:57:00.757186 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:57:00.756927    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:57:14.757417 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:14.757382    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:57:14.757937 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:57:14.757586    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:57:28.757216 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:28.757182    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:57:28.757619 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:57:28.757379    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5_odh-ai-gateway-infra(39787f18-682c-463a-a6ae-23a3f4f19063)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" podUID="39787f18-682c-463a-a6ae-23a3f4f19063"
Jul 17 21:57:40.674816 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.674777    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:57:40.810226 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.810197    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:57:40.905773 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.905744    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls\") pod \"39787f18-682c-463a-a6ae-23a3f4f19063\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") "
Jul 17 21:57:40.905969 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.905856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrrzd\" (UniqueName: \"kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd\") pod \"39787f18-682c-463a-a6ae-23a3f4f19063\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") "
Jul 17 21:57:40.905969 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.905881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca\") pod \"39787f18-682c-463a-a6ae-23a3f4f19063\" (UID: \"39787f18-682c-463a-a6ae-23a3f4f19063\") "
Jul 17 21:57:40.906327 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.906300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39787f18-682c-463a-a6ae-23a3f4f19063" (UID: "39787f18-682c-463a-a6ae-23a3f4f19063"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:57:40.908014 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.907988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39787f18-682c-463a-a6ae-23a3f4f19063" (UID: "39787f18-682c-463a-a6ae-23a3f4f19063"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:57:40.908121 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.908065    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd" (OuterVolumeSpecName: "kube-api-access-vrrzd") pod "39787f18-682c-463a-a6ae-23a3f4f19063" (UID: "39787f18-682c-463a-a6ae-23a3f4f19063"). InnerVolumeSpecName "kube-api-access-vrrzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:57:40.997640 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.997613    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"
Jul 17 21:57:40.997818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.997652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5" event={"ID":"39787f18-682c-463a-a6ae-23a3f4f19063","Type":"ContainerDied","Data":"fd103a6078bd639ec862f4f57fa532ffe339a1105c4a37f01a5c9feefbe92cf5"}
Jul 17 21:57:40.997818 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:40.997717    2579 scope.go:117] "RemoveContainer" containerID="ef816168761054369a2e83f1de5c5fc6d34afd51604e09344578663e2060d2cd"
Jul 17 21:57:41.007270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.007243    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrrzd\" (UniqueName: \"kubernetes.io/projected/39787f18-682c-463a-a6ae-23a3f4f19063-kube-api-access-vrrzd\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:57:41.007270 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.007266    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39787f18-682c-463a-a6ae-23a3f4f19063-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:57:41.007404 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.007278    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39787f18-682c-463a-a6ae-23a3f4f19063-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:57:41.019709 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.019683    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:57:41.026266 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.026238    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24f6a20e-6c5746bc84-gqqk5"]
Jul 17 21:57:41.762481 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:57:41.762449    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" path="/var/lib/kubelet/pods/39787f18-682c-463a-a6ae-23a3f4f19063/volumes"
Jul 17 21:59:26.370189 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370153    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370572    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370585    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370595    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370602    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370611    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370617    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370623    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370628    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370635    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370640    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370656    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370661    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370724    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370732    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370738    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370744    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.372826 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.370750    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 21:59:26.373746 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.373731    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.383614 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.383595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6e20ff19-serving-cert\""
Jul 17 21:59:26.395230 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.395203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:26.400950 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.400922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.401084 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.400984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.401138 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.401110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7sl\" (UniqueName: \"kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.502081 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.502046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7sl\" (UniqueName: \"kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.502293 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.502117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.502293 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.502151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.502293 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:59:26.502275    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-serving-cert: secret "maas-api-e2e-mt-6e20ff19-serving-cert" not found
Jul 17 21:59:26.502468 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:59:26.502354    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls podName:5591578b-09ad-47fe-aaa0-b34f91c8ef2a nodeName:}" failed. No retries permitted until 2026-07-17 21:59:27.002332508 +0000 UTC m=+2533.783592214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls") pod "maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" (UID: "5591578b-09ad-47fe-aaa0-b34f91c8ef2a") : secret "maas-api-e2e-mt-6e20ff19-serving-cert" not found
Jul 17 21:59:26.502895 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.502878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:26.517409 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:26.517387    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7sl\" (UniqueName: \"kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:27.006693 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.006652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:27.009536 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.009508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") pod \"maas-api-e2e-mt-6e20ff19-7687986749-fdqk2\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:27.283605 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.283573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:27.429064 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.429031    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:27.430024 ip-10-0-128-177 kubenswrapper[2579]: W0717 21:59:27.429985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5591578b_09ad_47fe_aaa0_b34f91c8ef2a.slice/crio-5a8fdf975c8c38650e06d70616240936db3c1ac57510313db54b20f938ce6ed5 WatchSource:0}: Error finding container 5a8fdf975c8c38650e06d70616240936db3c1ac57510313db54b20f938ce6ed5: Status 404 returned error can't find the container with id 5a8fdf975c8c38650e06d70616240936db3c1ac57510313db54b20f938ce6ed5
Jul 17 21:59:27.431461 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.431441    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:59:27.518429 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:27.518387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" event={"ID":"5591578b-09ad-47fe-aaa0-b34f91c8ef2a","Type":"ContainerStarted","Data":"5a8fdf975c8c38650e06d70616240936db3c1ac57510313db54b20f938ce6ed5"}
Jul 17 21:59:28.527432 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:28.527399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" event={"ID":"5591578b-09ad-47fe-aaa0-b34f91c8ef2a","Type":"ContainerStarted","Data":"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"}
Jul 17 21:59:28.527918 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:28.527535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:28.547301 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:28.547247    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" podStartSLOduration=2.129198625 podStartE2EDuration="2.547232051s" totalImagesPullingTime="418.033426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:59:28.545469258 +0000 UTC m=+2535.326728996" watchObservedRunningTime="2026-07-17 21:59:28.547232051 +0000 UTC m=+2535.328491776"
Jul 17 21:59:34.538181 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:34.538154    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:48.246742 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.246707    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:48.247182 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.246949    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" podUID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" containerName="maas-api" containerID="cri-o://2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4" gracePeriod=30
Jul 17 21:59:48.497280 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.497209    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:48.613794 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.613727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m7sl\" (UniqueName: \"kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl\") pod \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") "
Jul 17 21:59:48.613991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.613885    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca\") pod \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") "
Jul 17 21:59:48.613991 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.613956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") pod \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\" (UID: \"5591578b-09ad-47fe-aaa0-b34f91c8ef2a\") "
Jul 17 21:59:48.614285 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.614261    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5591578b-09ad-47fe-aaa0-b34f91c8ef2a" (UID: "5591578b-09ad-47fe-aaa0-b34f91c8ef2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:59:48.616097 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.616071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5591578b-09ad-47fe-aaa0-b34f91c8ef2a" (UID: "5591578b-09ad-47fe-aaa0-b34f91c8ef2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:59:48.616174 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.616150    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl" (OuterVolumeSpecName: "kube-api-access-6m7sl") pod "5591578b-09ad-47fe-aaa0-b34f91c8ef2a" (UID: "5591578b-09ad-47fe-aaa0-b34f91c8ef2a"). InnerVolumeSpecName "kube-api-access-6m7sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:59:48.627148 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.627117    2579 generic.go:356] "Generic (PLEG): container finished" podID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" containerID="2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4" exitCode=0
Jul 17 21:59:48.627253 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.627170    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"
Jul 17 21:59:48.627253 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.627170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" event={"ID":"5591578b-09ad-47fe-aaa0-b34f91c8ef2a","Type":"ContainerDied","Data":"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"}
Jul 17 21:59:48.627253 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.627233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2" event={"ID":"5591578b-09ad-47fe-aaa0-b34f91c8ef2a","Type":"ContainerDied","Data":"5a8fdf975c8c38650e06d70616240936db3c1ac57510313db54b20f938ce6ed5"}
Jul 17 21:59:48.627376 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.627257    2579 scope.go:117] "RemoveContainer" containerID="2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"
Jul 17 21:59:48.636212 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.636190    2579 scope.go:117] "RemoveContainer" containerID="2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"
Jul 17 21:59:48.636473 ip-10-0-128-177 kubenswrapper[2579]: E0717 21:59:48.636453    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4\": container with ID starting with 2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4 not found: ID does not exist" containerID="2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"
Jul 17 21:59:48.636545 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.636480    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4"} err="failed to get container status \"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4\": rpc error: code = NotFound desc = could not find container \"2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4\": container with ID starting with 2841dafffa366853c9e1ed57a7f0565bde734e6fbe2a4f64a4b5bf9359da5aa4 not found: ID does not exist"
Jul 17 21:59:48.649859 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.649832    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:48.653742 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.653717    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6e20ff19-7687986749-fdqk2"]
Jul 17 21:59:48.714810 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.714747    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m7sl\" (UniqueName: \"kubernetes.io/projected/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-kube-api-access-6m7sl\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:59:48.714810 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.714805    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:59:48.714810 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:48.714819    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5591578b-09ad-47fe-aaa0-b34f91c8ef2a-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 21:59:49.762861 ip-10-0-128-177 kubenswrapper[2579]: I0717 21:59:49.762828    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" path="/var/lib/kubelet/pods/5591578b-09ad-47fe-aaa0-b34f91c8ef2a/volumes"
Jul 17 22:00:26.640278 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640248    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:00:26.640816 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640680    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" containerName="maas-api"
Jul 17 22:00:26.640816 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640691    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" containerName="maas-api"
Jul 17 22:00:26.640816 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640797    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5591578b-09ad-47fe-aaa0-b34f91c8ef2a" containerName="maas-api"
Jul 17 22:00:26.640816 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640809    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094c099e-85ad-45a7-bc79-671a5f520124" containerName="maas-api"
Jul 17 22:00:26.641046 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.640823    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39787f18-682c-463a-a6ae-23a3f4f19063" containerName="maas-api"
Jul 17 22:00:26.644069 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.644049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.647095 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.647075    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-479788cb-serving-cert\""
Jul 17 22:00:26.675335 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.675303    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:00:26.766354 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.766305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.766354 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.766355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctthv\" (UniqueName: \"kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.766594 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.766438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.867657 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.867606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.868016 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.867994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.868093 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.868030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctthv\" (UniqueName: \"kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.868625 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.868606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.870177 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.870156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.877759 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.877734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctthv\" (UniqueName: \"kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv\") pod \"maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:26.954841 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:26.954722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:27.300799 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:27.300751    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:00:27.303946 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:00:27.303900    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58c51fa_f9d3_493d_aaa1_50c8b8f608ef.slice/crio-d1942eb2b8cdda712cf095733f800bbb9dcc584b243fae127ff9b0bfa5a31fd2 WatchSource:0}: Error finding container d1942eb2b8cdda712cf095733f800bbb9dcc584b243fae127ff9b0bfa5a31fd2: Status 404 returned error can't find the container with id d1942eb2b8cdda712cf095733f800bbb9dcc584b243fae127ff9b0bfa5a31fd2
Jul 17 22:00:27.825212 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:27.825172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" event={"ID":"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef","Type":"ContainerStarted","Data":"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"}
Jul 17 22:00:27.825617 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:27.825231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" event={"ID":"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef","Type":"ContainerStarted","Data":"d1942eb2b8cdda712cf095733f800bbb9dcc584b243fae127ff9b0bfa5a31fd2"}
Jul 17 22:00:27.825617 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:27.825284    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:00:27.844466 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:27.844378    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" podStartSLOduration=1.521874116 podStartE2EDuration="1.844353449s" totalImagesPullingTime="322.479333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:00:27.841735439 +0000 UTC m=+2594.622995168" watchObservedRunningTime="2026-07-17 22:00:27.844353449 +0000 UTC m=+2594.625613176"
Jul 17 22:00:33.836239 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:00:33.836160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:01:29.800419 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:29.800377    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:01:29.801037 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:29.800633    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" podUID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" containerName="maas-api" containerID="cri-o://c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468" gracePeriod=30
Jul 17 22:01:30.053807 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.053720    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:01:30.065189 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.065152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls\") pod \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") "
Jul 17 22:01:30.065346 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.065288    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca\") pod \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") "
Jul 17 22:01:30.065346 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.065326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctthv\" (UniqueName: \"kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv\") pod \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\" (UID: \"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef\") "
Jul 17 22:01:30.065689 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.065659    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" (UID: "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:01:30.067475 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.067438    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" (UID: "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:01:30.067916 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.067890    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv" (OuterVolumeSpecName: "kube-api-access-ctthv") pod "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" (UID: "b58c51fa-f9d3-493d-aaa1-50c8b8f608ef"). InnerVolumeSpecName "kube-api-access-ctthv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:01:30.138236 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.138204    2579 generic.go:356] "Generic (PLEG): container finished" podID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" containerID="c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468" exitCode=0
Jul 17 22:01:30.138236 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.138254    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"
Jul 17 22:01:30.138454 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.138294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" event={"ID":"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef","Type":"ContainerDied","Data":"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"}
Jul 17 22:01:30.138454 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.138347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt" event={"ID":"b58c51fa-f9d3-493d-aaa1-50c8b8f608ef","Type":"ContainerDied","Data":"d1942eb2b8cdda712cf095733f800bbb9dcc584b243fae127ff9b0bfa5a31fd2"}
Jul 17 22:01:30.138454 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.138373    2579 scope.go:117] "RemoveContainer" containerID="c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"
Jul 17 22:01:30.147722 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.147703    2579 scope.go:117] "RemoveContainer" containerID="c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"
Jul 17 22:01:30.147995 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:01:30.147974    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468\": container with ID starting with c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468 not found: ID does not exist" containerID="c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"
Jul 17 22:01:30.148052 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.148004    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468"} err="failed to get container status \"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468\": rpc error: code = NotFound desc = could not find container \"c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468\": container with ID starting with c9fc970d7dcc980f9d2897b0396a0cdafaed6453f5f37e9618ed2e7cfb05f468 not found: ID does not exist"
Jul 17 22:01:30.161134 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.161105    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:01:30.166639 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.166612    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:01:30.166639 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.166639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctthv\" (UniqueName: \"kubernetes.io/projected/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-kube-api-access-ctthv\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:01:30.166903 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.166650    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:01:30.167371 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:30.167353    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-479788cb-6f6bf59c64-sjmrt"]
Jul 17 22:01:31.762103 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:01:31.762070    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" path="/var/lib/kubelet/pods/b58c51fa-f9d3-493d-aaa1-50c8b8f608ef/volumes"
Jul 17 22:03:23.820171 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.820138    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:03:23.820808 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.820788    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" containerName="maas-api"
Jul 17 22:03:23.820909 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.820812    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" containerName="maas-api"
Jul 17 22:03:23.820986 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.820963    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58c51fa-f9d3-493d-aaa1-50c8b8f608ef" containerName="maas-api"
Jul 17 22:03:23.824383 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.824363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:23.826950 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.826931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-592f58-serving-cert\""
Jul 17 22:03:23.840197 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.840170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:03:23.943007 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.942968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6xj\" (UniqueName: \"kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:23.943195 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.943102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:23.943195 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:23.943167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.043830 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.043794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6xj\" (UniqueName: \"kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.044030 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.043869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.044030 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.043899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.044030 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:03:24.044001    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-serving-cert: secret "maas-api-e2e-inf-a-592f58-serving-cert" not found
Jul 17 22:03:24.044200 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:03:24.044073    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls podName:15cb8f5c-ade1-480b-8f96-b638f5d5e22c nodeName:}" failed. No retries permitted until 2026-07-17 22:03:24.544049918 +0000 UTC m=+2771.325309642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls") pod "maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" (UID: "15cb8f5c-ade1-480b-8f96-b638f5d5e22c") : secret "maas-api-e2e-inf-a-592f58-serving-cert" not found
Jul 17 22:03:24.044623 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.044601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.053161 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.053132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6xj\" (UniqueName: \"kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.548223 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.548181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.550845 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.550823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") pod \"maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.735932 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.735899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:24.882590 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:24.882558    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:03:24.888061 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:03:24.888027    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cb8f5c_ade1_480b_8f96_b638f5d5e22c.slice/crio-6dc66b700038e3b3fad18f01e9430063aa6aa7b61de9b740dac155619d107830 WatchSource:0}: Error finding container 6dc66b700038e3b3fad18f01e9430063aa6aa7b61de9b740dac155619d107830: Status 404 returned error can't find the container with id 6dc66b700038e3b3fad18f01e9430063aa6aa7b61de9b740dac155619d107830
Jul 17 22:03:25.730376 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:25.730279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" event={"ID":"15cb8f5c-ade1-480b-8f96-b638f5d5e22c","Type":"ContainerStarted","Data":"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"}
Jul 17 22:03:25.730376 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:25.730352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" event={"ID":"15cb8f5c-ade1-480b-8f96-b638f5d5e22c","Type":"ContainerStarted","Data":"6dc66b700038e3b3fad18f01e9430063aa6aa7b61de9b740dac155619d107830"}
Jul 17 22:03:25.730376 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:25.730374    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:25.749320 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:25.749264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" podStartSLOduration=2.354224257 podStartE2EDuration="2.749238654s" totalImagesPullingTime="395.014397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:03:25.749054111 +0000 UTC m=+2772.530313840" watchObservedRunningTime="2026-07-17 22:03:25.749238654 +0000 UTC m=+2772.530498379"
Jul 17 22:03:31.742737 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:31.742707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:03:31.935329 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:31.935288    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:03:31.939263 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:31.939235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:31.947779 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:31.947732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6be22b-serving-cert\""
Jul 17 22:03:31.955243 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:31.955214    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:03:32.023723 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.023690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.023917 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.023821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55hj\" (UniqueName: \"kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.023917 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.023886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.124904 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.124861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.125083 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.124921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.125083 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.125011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55hj\" (UniqueName: \"kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.125083 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:03:32.125036    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-serving-cert: secret "maas-api-e2e-inf-b-6be22b-serving-cert" not found
Jul 17 22:03:32.125190 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:03:32.125124    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls podName:25002b67-fb5a-4341-91ae-0b134f15150a nodeName:}" failed. No retries permitted until 2026-07-17 22:03:32.625106998 +0000 UTC m=+2779.406366704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls") pod "maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" (UID: "25002b67-fb5a-4341-91ae-0b134f15150a") : secret "maas-api-e2e-inf-b-6be22b-serving-cert" not found
Jul 17 22:03:32.125463 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.125446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.134401 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.134374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55hj\" (UniqueName: \"kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.629863 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.629828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.632542 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.632514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") pod \"maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.850526 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.850491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:32.994446 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:32.994418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:03:32.996303 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:03:32.996277    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25002b67_fb5a_4341_91ae_0b134f15150a.slice/crio-60caa3f3cddb0b33ac2b3797d09171f554fcf955286026701311a57363b5565d WatchSource:0}: Error finding container 60caa3f3cddb0b33ac2b3797d09171f554fcf955286026701311a57363b5565d: Status 404 returned error can't find the container with id 60caa3f3cddb0b33ac2b3797d09171f554fcf955286026701311a57363b5565d
Jul 17 22:03:33.773058 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:33.773021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" event={"ID":"25002b67-fb5a-4341-91ae-0b134f15150a","Type":"ContainerStarted","Data":"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"}
Jul 17 22:03:33.773222 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:33.773087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" event={"ID":"25002b67-fb5a-4341-91ae-0b134f15150a","Type":"ContainerStarted","Data":"60caa3f3cddb0b33ac2b3797d09171f554fcf955286026701311a57363b5565d"}
Jul 17 22:03:33.773269 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:33.773220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:03:33.790133 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:33.790065    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" podStartSLOduration=2.374937429 podStartE2EDuration="2.790044703s" totalImagesPullingTime="415.107274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:03:33.788622252 +0000 UTC m=+2780.569881975" watchObservedRunningTime="2026-07-17 22:03:33.790044703 +0000 UTC m=+2780.571304432"
Jul 17 22:03:39.784625 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:03:39.784594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:04:42.127556 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:04:42.127513    2579 controller.go:195] "Failed to update lease" err="Put \"https://a152ca601a1b44b99bf6feebaebf6509-6a2671be78ca2423.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-177.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 17 22:04:52.128346 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:04:52.128289    2579 controller.go:195] "Failed to update lease" err="Put \"https://a152ca601a1b44b99bf6feebaebf6509-6a2671be78ca2423.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-177.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 22:05:02.129609 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:02.129557    2579 controller.go:195] "Failed to update lease" err="Put \"https://a152ca601a1b44b99bf6feebaebf6509-6a2671be78ca2423.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-177.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 17 22:05:02.479930 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:02.479819    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-17T22:04:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-17T22:04:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-17T22:04:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-17T22:04:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-128-177.ec2.internal\": Patch \"https://a152ca601a1b44b99bf6feebaebf6509-6a2671be78ca2423.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-128-177.ec2.internal/status?timeout=10s\": context deadline exceeded"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931640    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931695    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931704    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z7bfd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931727    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931727    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931719    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931744    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931799    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931846    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931855    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931870    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8zcw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.931896 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931884    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kgl8q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931885    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlptf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931911    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931910    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931931    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931936    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931945    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwcbh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931950    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931970    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931978    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931990    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.931985    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932011    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-xntmp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932075    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932104    2579 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932116    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932124    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cqqj2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932133    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.932899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932166    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tk7km\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932190    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932191    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932199    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932199    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-l2t6f\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932221    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932225    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932248    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932278    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932280    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932279    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932305    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6be22b-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932315    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932336    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932343    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pjdhp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932352    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932379    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932374    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.933683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932424    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932425    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932440    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932444    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932460    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-76xj8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:09.932455    2579 controller.go:195] "Failed to update lease" err="Put \"https://a152ca601a1b44b99bf6feebaebf6509-6a2671be78ca2423.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-177.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932471    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932483    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932492    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpmh2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932498    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932555    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932560    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932586    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932591    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932615    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932615    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932624    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932637    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932659    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932679    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932677    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932691    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932686    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932698    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932708    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mcl6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932715    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932727    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932732    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932741    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p8ktt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932751    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932755    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zjnzc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932792    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-8esp3oqf4q4vu\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932807    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932820    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932830    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932844    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.934758 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932863    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932881    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932893    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dvmrq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932898    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932909    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zsgdh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932912    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932922    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932937    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932941    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932954    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9bhcn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932964    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932973    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932977    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6d45\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932990    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzlv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932995    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxq7h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933005    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933013    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933022    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935360 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933025    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvj24\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933030    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-574l5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.932979    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933050    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933058    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933062    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933078    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933084    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9rlz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933088    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933088    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933105    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933112    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933118    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933127    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-592f58-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933141    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933151    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933157    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933163    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.935898 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933165    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933043    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933183    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933079    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933191    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pdsk9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933199    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933168    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56bcr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933205    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933114    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rl93qob9s1bu\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933219    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933233    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933236    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933219    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933248    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vktg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933254    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933221    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sq5l8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933281    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933294    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.936458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933297    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933302    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xr6tj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933191    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933314    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933256    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933325    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933314    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933339    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933254    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933326    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933360    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933284    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933374    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933286    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933380    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933388    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933391    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5fwnk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933366    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933393    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-dockercfg-pxj2w\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933409    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933416    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2uehn484iltr4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933431    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933435    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933439    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933438    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933449    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933339    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zxg6r\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933412    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933412    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933452    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fqtx5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933474    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-z79wp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933476    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5ll9z\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933467    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933436    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59znh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933464    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8s8c5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:09.937726 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:09.933498    2579 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jd2l5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 17 22:05:10.738792 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.738738    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 22:05:10.745095 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.745075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 22:05:10.749538 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.749520    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxq7h\""
Jul 17 22:05:10.751436 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.751415    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 22:05:10.756426 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.756411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sq5l8\""
Jul 17 22:05:10.757949 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.757929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-592f58-serving-cert\""
Jul 17 22:05:10.760508 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.760482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 22:05:10.760760 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.760744    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 22:05:10.761958 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.761944    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 22:05:10.767817 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.767803    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 22:05:10.770925 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.770909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 22:05:10.773920 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.773907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.787919 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.787896    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 22:05:10.788944 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.788921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zxg6r\""
Jul 17 22:05:10.796358 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.796343    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 22:05:10.801286 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.801268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwcbh\""
Jul 17 22:05:10.802622 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.802609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 22:05:10.803189 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.803175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fqtx5\""
Jul 17 22:05:10.806356 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.806337    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 22:05:10.810056 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.810042    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 22:05:10.811946 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.811932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kgl8q\""
Jul 17 22:05:10.813825 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.813797    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 22:05:10.818624 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.818611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 22:05:10.819562 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.819548    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z79wp\""
Jul 17 22:05:10.822499 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.822486    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.835181 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.835162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 22:05:10.835254 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.835228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l2t6f\""
Jul 17 22:05:10.841351 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.841333    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 22:05:10.844932 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.844918    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.846627 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.846612    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 22:05:10.864063 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.864045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.873163 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.873145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 22:05:10.874221 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.874208    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.881532 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.881512    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.892050 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.892027    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 22:05:10.894164 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.894145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 22:05:10.894296 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.894271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 17 22:05:10.899153 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.899136    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 22:05:10.912527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.912505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tk7km\""
Jul 17 22:05:10.914656 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.914634    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 22:05:10.916492 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.916476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzlv\""
Jul 17 22:05:10.919596 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.919581    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 22:05:10.929981 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.929960    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 22:05:10.936207 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.936189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pjdhp\""
Jul 17 22:05:10.942167 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.942146    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 22:05:10.949840 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.949813    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 17 22:05:10.954090 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.954066    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 22:05:10.967378 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.967351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 22:05:10.974904 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.974881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 22:05:10.979866 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.979849    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 22:05:10.985061 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.985038    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 22:05:10.996424 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.996372    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 22:05:10.998442 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.998422    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5fwnk\""
Jul 17 22:05:10.999392 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:10.999375    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 22:05:11.001406 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.001390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pxj2w\""
Jul 17 22:05:11.004889 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.004875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jd2l5\""
Jul 17 22:05:11.006876 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.006861    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 22:05:11.007878 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.007864    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8s8c5\""
Jul 17 22:05:11.008555 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.008543    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvj24\""
Jul 17 22:05:11.020011 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.019995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.023075 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.023060    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 22:05:11.026066 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.026052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 22:05:11.043203 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.043182    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 22:05:11.043859 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.043842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.044901 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.044886    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6d45\""
Jul 17 22:05:11.045271 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.045254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pdsk9\""
Jul 17 22:05:11.060644 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.060615    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.061708 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.061691    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.066020 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.066001    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9bhcn\""
Jul 17 22:05:11.075116 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.075094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 22:05:11.075254 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.075201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 22:05:11.081345 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.081326    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 22:05:11.085208 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.085192    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.088178 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.088165    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 22:05:11.090037 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.090022    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.098291 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.098261    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 22:05:11.110521 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.110505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 22:05:11.116612 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.116588    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.118477 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.118460    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 22:05:11.119393 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.119378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 22:05:11.120333 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.120321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 22:05:11.121088 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.121073    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.130590 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.130577    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 22:05:11.134747 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.134733    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.135674 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.135659    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 22:05:11.147003 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.146986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vktg\""
Jul 17 22:05:11.149326 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.149308    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rl93qob9s1bu\""
Jul 17 22:05:11.155674 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.155632    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 22:05:11.155857 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.155842    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 22:05:11.158868 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.158853    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 22:05:11.159575 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.159561    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpmh2\""
Jul 17 22:05:11.165515 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.165499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 22:05:11.169215 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.169199    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dvmrq\""
Jul 17 22:05:11.170524 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.170508    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 22:05:11.170890 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.170876    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 22:05:11.172057 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.172044    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.181228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.181206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9rlz\""
Jul 17 22:05:11.192023 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.191999    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zsgdh\""
Jul 17 22:05:11.192995 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.192978    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 22:05:11.193729 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.193715    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.200873 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.200855    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 22:05:11.201959 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.201945    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zjnzc\""
Jul 17 22:05:11.216659 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.216638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 22:05:11.218300 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.218283    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 22:05:11.229635 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.229611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 22:05:11.234899 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.234876    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.249186 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.249125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 22:05:11.255220 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.255194    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 22:05:11.255343 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.255250    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cqqj2\""
Jul 17 22:05:11.264168 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.264143    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.264168 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.264144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 22:05:11.269458 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.269441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.287119 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.287096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.288903 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.288885    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 22:05:11.289343 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.289330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 22:05:11.292934 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.292921    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 22:05:11.295950 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.295935    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 22:05:11.296093 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.296077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mcl6\""
Jul 17 22:05:11.299142 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.299128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 22:05:11.300243 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.300225    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.302777 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.302724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56bcr\""
Jul 17 22:05:11.305940 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.305920    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 22:05:11.314605 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.310263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8esp3oqf4q4vu\""
Jul 17 22:05:11.314605 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.310997    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 22:05:11.314605 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.311897    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlptf\""
Jul 17 22:05:11.316092 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.316062    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:05:11.316336 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.316312    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" podUID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" containerName="maas-api" containerID="cri-o://b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d" gracePeriod=30
Jul 17 22:05:11.320798 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.320760    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xr6tj\""
Jul 17 22:05:11.322171 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.322151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 22:05:11.339067 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.339036    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 22:05:11.358939 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.358908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 22:05:11.379618 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.379590    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 22:05:11.399423 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.399391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.419042 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.419014    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.439072 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.439043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-76xj8\""
Jul 17 22:05:11.459307 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.459279    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5ll9z\""
Jul 17 22:05:11.478678 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.478652    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.500004 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.499931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p8ktt\""
Jul 17 22:05:11.519551 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.519526    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 22:05:11.539334 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.539310    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.559142 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.559115    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.565196 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.565172    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:05:11.579255 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.579225    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 22:05:11.599503 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.599477    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 22:05:11.618919 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.618895    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.638918 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.638891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 22:05:11.664612 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.664583    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") pod \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") "
Jul 17 22:05:11.664751 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.664629    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca\") pod \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") "
Jul 17 22:05:11.664751 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.664654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6xj\" (UniqueName: \"kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj\") pod \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\" (UID: \"15cb8f5c-ade1-480b-8f96-b638f5d5e22c\") "
Jul 17 22:05:11.665054 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.665020    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 22:05:11.665138 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.665075    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15cb8f5c-ade1-480b-8f96-b638f5d5e22c" (UID: "15cb8f5c-ade1-480b-8f96-b638f5d5e22c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:05:11.666998 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.666973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15cb8f5c-ade1-480b-8f96-b638f5d5e22c" (UID: "15cb8f5c-ade1-480b-8f96-b638f5d5e22c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:05:11.667087 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.666996    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj" (OuterVolumeSpecName: "kube-api-access-ct6xj") pod "15cb8f5c-ade1-480b-8f96-b638f5d5e22c" (UID: "15cb8f5c-ade1-480b-8f96-b638f5d5e22c"). InnerVolumeSpecName "kube-api-access-ct6xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:05:11.679877 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.679855    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 22:05:11.699640 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.699608    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 22:05:11.719279 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.719245    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6be22b-serving-cert\""
Jul 17 22:05:11.738869 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.738838    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 22:05:11.759292 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.759210    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59znh\""
Jul 17 22:05:11.765802 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.765757    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6xj\" (UniqueName: \"kubernetes.io/projected/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-kube-api-access-ct6xj\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:11.765802 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.765804    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:11.765966 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.765813    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cb8f5c-ade1-480b-8f96-b638f5d5e22c-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:11.779585 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.779560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 22:05:11.798941 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.798915    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xntmp\""
Jul 17 22:05:11.819541 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.819516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 22:05:11.839234 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.839211    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 22:05:11.858916 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.858892    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 17 22:05:11.879020 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.878996    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 22:05:11.899682 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.899655    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2uehn484iltr4\""
Jul 17 22:05:11.919336 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.919312    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 22:05:11.939266 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.939244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 22:05:11.959430 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.959404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 22:05:11.979022 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.978999    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8zcw\""
Jul 17 22:05:11.999741 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:11.999721    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 22:05:12.019665 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.019639    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 22:05:12.039570 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.039545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 22:05:12.059265 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.059240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 22:05:12.079554 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.079522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 22:05:12.099646 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.099621    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 22:05:12.119951 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.119926    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 22:05:12.139067 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.139038    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 22:05:12.159490 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.159458    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 22:05:12.178967 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.178944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z7bfd\""
Jul 17 22:05:12.200014 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.199989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 22:05:12.218756 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.218732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-574l5\""
Jul 17 22:05:12.266702 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.266669    2579 generic.go:356] "Generic (PLEG): container finished" podID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" containerID="b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d" exitCode=0
Jul 17 22:05:12.266892 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.266713    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"
Jul 17 22:05:12.266892 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.266791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" event={"ID":"15cb8f5c-ade1-480b-8f96-b638f5d5e22c","Type":"ContainerDied","Data":"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"}
Jul 17 22:05:12.266892 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.266842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw" event={"ID":"15cb8f5c-ade1-480b-8f96-b638f5d5e22c","Type":"ContainerDied","Data":"6dc66b700038e3b3fad18f01e9430063aa6aa7b61de9b740dac155619d107830"}
Jul 17 22:05:12.266892 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.266865    2579 scope.go:117] "RemoveContainer" containerID="b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"
Jul 17 22:05:12.277744 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.277722    2579 scope.go:117] "RemoveContainer" containerID="b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"
Jul 17 22:05:12.278075 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:12.278042    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d\": container with ID starting with b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d not found: ID does not exist" containerID="b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"
Jul 17 22:05:12.278163 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.278084    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d"} err="failed to get container status \"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d\": rpc error: code = NotFound desc = could not find container \"b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d\": container with ID starting with b2922cd5ce5ac6f9a7109684a3a7459084ea7830369f16802ce2d9a4c7b1d53d not found: ID does not exist"
Jul 17 22:05:12.307976 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.307944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:05:12.312548 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:12.312512    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-592f58-b4dc6d599-ms7kw"]
Jul 17 22:05:13.763781 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:13.763739    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" path="/var/lib/kubelet/pods/15cb8f5c-ade1-480b-8f96-b638f5d5e22c/volumes"
Jul 17 22:05:37.170832 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.170791    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:05:37.171261 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.171086    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" podUID="25002b67-fb5a-4341-91ae-0b134f15150a" containerName="maas-api" containerID="cri-o://ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d" gracePeriod=30
Jul 17 22:05:37.626318 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.626293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:05:37.810182 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.810140    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x55hj\" (UniqueName: \"kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj\") pod \"25002b67-fb5a-4341-91ae-0b134f15150a\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") "
Jul 17 22:05:37.810399 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.810209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca\") pod \"25002b67-fb5a-4341-91ae-0b134f15150a\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") "
Jul 17 22:05:37.810399 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.810274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") pod \"25002b67-fb5a-4341-91ae-0b134f15150a\" (UID: \"25002b67-fb5a-4341-91ae-0b134f15150a\") "
Jul 17 22:05:37.810583 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.810557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "25002b67-fb5a-4341-91ae-0b134f15150a" (UID: "25002b67-fb5a-4341-91ae-0b134f15150a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:05:37.812487 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.812462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "25002b67-fb5a-4341-91ae-0b134f15150a" (UID: "25002b67-fb5a-4341-91ae-0b134f15150a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:05:37.812487 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.812476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj" (OuterVolumeSpecName: "kube-api-access-x55hj") pod "25002b67-fb5a-4341-91ae-0b134f15150a" (UID: "25002b67-fb5a-4341-91ae-0b134f15150a"). InnerVolumeSpecName "kube-api-access-x55hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:05:37.912100 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.912069    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25002b67-fb5a-4341-91ae-0b134f15150a-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:37.912100 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.912098    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25002b67-fb5a-4341-91ae-0b134f15150a-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:37.912321 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:37.912107    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x55hj\" (UniqueName: \"kubernetes.io/projected/25002b67-fb5a-4341-91ae-0b134f15150a-kube-api-access-x55hj\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:05:38.400292 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.400249    2579 generic.go:356] "Generic (PLEG): container finished" podID="25002b67-fb5a-4341-91ae-0b134f15150a" containerID="ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d" exitCode=0
Jul 17 22:05:38.400791 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.400294    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"
Jul 17 22:05:38.400791 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.400330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" event={"ID":"25002b67-fb5a-4341-91ae-0b134f15150a","Type":"ContainerDied","Data":"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"}
Jul 17 22:05:38.400791 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.400389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f" event={"ID":"25002b67-fb5a-4341-91ae-0b134f15150a","Type":"ContainerDied","Data":"60caa3f3cddb0b33ac2b3797d09171f554fcf955286026701311a57363b5565d"}
Jul 17 22:05:38.400791 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.400408    2579 scope.go:117] "RemoveContainer" containerID="ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"
Jul 17 22:05:38.409903 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.409879    2579 scope.go:117] "RemoveContainer" containerID="ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"
Jul 17 22:05:38.410186 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:38.410165    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d\": container with ID starting with ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d not found: ID does not exist" containerID="ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"
Jul 17 22:05:38.410226 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.410200    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d"} err="failed to get container status \"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d\": rpc error: code = NotFound desc = could not find container \"ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d\": container with ID starting with ebacab5d94c8d2d068a50fba6996d71d3699408197d08551fa06eea6ab16ac2d not found: ID does not exist"
Jul 17 22:05:38.422823 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.422790    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:05:38.428230 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:38.428198    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6be22b-74497cfd76-rdq7f"]
Jul 17 22:05:39.763503 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:39.763467    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25002b67-fb5a-4341-91ae-0b134f15150a" path="/var/lib/kubelet/pods/25002b67-fb5a-4341-91ae-0b134f15150a/volumes"
Jul 17 22:05:56.692583 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.692544    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:05:56.693192 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693155    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25002b67-fb5a-4341-91ae-0b134f15150a" containerName="maas-api"
Jul 17 22:05:56.693192 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693181    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25002b67-fb5a-4341-91ae-0b134f15150a" containerName="maas-api"
Jul 17 22:05:56.693337 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693217    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" containerName="maas-api"
Jul 17 22:05:56.693337 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693225    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" containerName="maas-api"
Jul 17 22:05:56.693337 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693331    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25002b67-fb5a-4341-91ae-0b134f15150a" containerName="maas-api"
Jul 17 22:05:56.693483 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.693345    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cb8f5c-ade1-480b-8f96-b638f5d5e22c" containerName="maas-api"
Jul 17 22:05:56.696372 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.696351    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.699063 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.699036    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e12150-serving-cert\""
Jul 17 22:05:56.709380 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.709353    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:05:56.780730 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.780685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5st4\" (UniqueName: \"kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.780960 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.780807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.780960 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.780840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.882085 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.882047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.882303 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.882102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.882303 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:56.882210    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-serving-cert: secret "maas-api-e2e-api-a-e12150-serving-cert" not found
Jul 17 22:05:56.882303 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:05:56.882293    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls podName:e3477c63-d0a5-47fe-b8b5-76bfa0888266 nodeName:}" failed. No retries permitted until 2026-07-17 22:05:57.382270683 +0000 UTC m=+2924.163530388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls") pod "maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" (UID: "e3477c63-d0a5-47fe-b8b5-76bfa0888266") : secret "maas-api-e2e-api-a-e12150-serving-cert" not found
Jul 17 22:05:56.882825 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.882807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.882884 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.882838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5st4\" (UniqueName: \"kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:56.892079 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:56.892052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5st4\" (UniqueName: \"kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:57.387574 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:57.387536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:57.390163 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:57.390140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") pod \"maas-api-e2e-api-a-e12150-6df59b9867-cr4pr\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:57.607623 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:57.607584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:57.768412 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:57.768349    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:05:57.770803 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:05:57.770738    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3477c63_d0a5_47fe_b8b5_76bfa0888266.slice/crio-e049389dd5d270f46eae67ccf45f9f874a9c433128b661663fa864166b202e00 WatchSource:0}: Error finding container e049389dd5d270f46eae67ccf45f9f874a9c433128b661663fa864166b202e00: Status 404 returned error can't find the container with id e049389dd5d270f46eae67ccf45f9f874a9c433128b661663fa864166b202e00
Jul 17 22:05:57.772102 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:57.772083    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 22:05:58.502912 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:58.502876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" event={"ID":"e3477c63-d0a5-47fe-b8b5-76bfa0888266","Type":"ContainerStarted","Data":"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"}
Jul 17 22:05:58.503071 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:58.502937    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:05:58.503071 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:58.502953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" event={"ID":"e3477c63-d0a5-47fe-b8b5-76bfa0888266","Type":"ContainerStarted","Data":"e049389dd5d270f46eae67ccf45f9f874a9c433128b661663fa864166b202e00"}
Jul 17 22:05:58.527350 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:05:58.527297    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" podStartSLOduration=1.979828135 podStartE2EDuration="2.527278762s" totalImagesPullingTime="547.450627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:05:58.52708527 +0000 UTC m=+2925.308345007" watchObservedRunningTime="2026-07-17 22:05:58.527278762 +0000 UTC m=+2925.308538488"
Jul 17 22:06:04.513850 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.513823    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:06:04.858554 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.858443    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:04.866540 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.866516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:04.869988 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.869959    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-92c219-serving-cert\""
Jul 17 22:06:04.878535 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.878501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:04.965997 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.965946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:04.966194 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.966064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzc4l\" (UniqueName: \"kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:04.966194 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:04.966122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.067450 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.067411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.067631 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.067478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzc4l\" (UniqueName: \"kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.067631 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.067517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.067701 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:06:05.067653    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-serving-cert: secret "maas-api-e2e-api-b-92c219-serving-cert" not found
Jul 17 22:06:05.067737 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:06:05.067720    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls podName:cf1d275f-0aea-430f-b728-31a4e89342d8 nodeName:}" failed. No retries permitted until 2026-07-17 22:06:05.56770166 +0000 UTC m=+2932.348961366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls") pod "maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" (UID: "cf1d275f-0aea-430f-b728-31a4e89342d8") : secret "maas-api-e2e-api-b-92c219-serving-cert" not found
Jul 17 22:06:05.068100 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.068079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.076029 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.076002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzc4l\" (UniqueName: \"kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.573299 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.573256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.576004 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.575975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") pod \"maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.779751 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.779718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:05.939399 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:05.939367    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:05.940495 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:06:05.940468    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1d275f_0aea_430f_b728_31a4e89342d8.slice/crio-a21021fde9b4355977cef15949083cd8c3cc8e31a651d9a861986257e166e80d WatchSource:0}: Error finding container a21021fde9b4355977cef15949083cd8c3cc8e31a651d9a861986257e166e80d: Status 404 returned error can't find the container with id a21021fde9b4355977cef15949083cd8c3cc8e31a651d9a861986257e166e80d
Jul 17 22:06:06.550001 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:06.549963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" event={"ID":"cf1d275f-0aea-430f-b728-31a4e89342d8","Type":"ContainerStarted","Data":"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"}
Jul 17 22:06:06.550165 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:06.550028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" event={"ID":"cf1d275f-0aea-430f-b728-31a4e89342d8","Type":"ContainerStarted","Data":"a21021fde9b4355977cef15949083cd8c3cc8e31a651d9a861986257e166e80d"}
Jul 17 22:06:06.550165 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:06.550141    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:06.569697 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:06.569644    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" podStartSLOduration=2.117302872 podStartE2EDuration="2.569629988s" totalImagesPullingTime="452.327116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:06:06.568973791 +0000 UTC m=+2933.350233519" watchObservedRunningTime="2026-07-17 22:06:06.569629988 +0000 UTC m=+2933.350889715"
Jul 17 22:06:12.561120 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:12.561092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:27.133656 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.133615    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:06:27.134253 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.133929    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" podUID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" containerName="maas-api" containerID="cri-o://6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790" gracePeriod=30
Jul 17 22:06:27.384805 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.384705    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:06:27.489208 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.489167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5st4\" (UniqueName: \"kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4\") pod \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") "
Jul 17 22:06:27.489208 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.489221    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") pod \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") "
Jul 17 22:06:27.489472 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.489303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca\") pod \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\" (UID: \"e3477c63-d0a5-47fe-b8b5-76bfa0888266\") "
Jul 17 22:06:27.489699 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.489673    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3477c63-d0a5-47fe-b8b5-76bfa0888266" (UID: "e3477c63-d0a5-47fe-b8b5-76bfa0888266"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:06:27.491530 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.491499    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3477c63-d0a5-47fe-b8b5-76bfa0888266" (UID: "e3477c63-d0a5-47fe-b8b5-76bfa0888266"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:06:27.491530 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.491512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4" (OuterVolumeSpecName: "kube-api-access-w5st4") pod "e3477c63-d0a5-47fe-b8b5-76bfa0888266" (UID: "e3477c63-d0a5-47fe-b8b5-76bfa0888266"). InnerVolumeSpecName "kube-api-access-w5st4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:06:27.590718 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.590683    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3477c63-d0a5-47fe-b8b5-76bfa0888266-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:27.590718 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.590713    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5st4\" (UniqueName: \"kubernetes.io/projected/e3477c63-d0a5-47fe-b8b5-76bfa0888266-kube-api-access-w5st4\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:27.590718 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.590724    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3477c63-d0a5-47fe-b8b5-76bfa0888266-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:27.655630 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.655541    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" containerID="6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790" exitCode=0
Jul 17 22:06:27.655630 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.655585    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"
Jul 17 22:06:27.655828 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.655633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" event={"ID":"e3477c63-d0a5-47fe-b8b5-76bfa0888266","Type":"ContainerDied","Data":"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"}
Jul 17 22:06:27.655828 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.655689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr" event={"ID":"e3477c63-d0a5-47fe-b8b5-76bfa0888266","Type":"ContainerDied","Data":"e049389dd5d270f46eae67ccf45f9f874a9c433128b661663fa864166b202e00"}
Jul 17 22:06:27.655828 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.655715    2579 scope.go:117] "RemoveContainer" containerID="6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"
Jul 17 22:06:27.664935 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.664919    2579 scope.go:117] "RemoveContainer" containerID="6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"
Jul 17 22:06:27.665168 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:06:27.665149    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790\": container with ID starting with 6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790 not found: ID does not exist" containerID="6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"
Jul 17 22:06:27.665216 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.665176    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790"} err="failed to get container status \"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790\": rpc error: code = NotFound desc = could not find container \"6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790\": container with ID starting with 6adb5bcbd7bf0d883677f16549daeb73b982c931f9a18255e8f5028cc83d9790 not found: ID does not exist"
Jul 17 22:06:27.680389 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.680350    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:06:27.683601 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.683578    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e12150-6df59b9867-cr4pr"]
Jul 17 22:06:27.763305 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:27.763273    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" path="/var/lib/kubelet/pods/e3477c63-d0a5-47fe-b8b5-76bfa0888266/volumes"
Jul 17 22:06:53.316840 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.316796    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:53.317287 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.317037    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" podUID="cf1d275f-0aea-430f-b728-31a4e89342d8" containerName="maas-api" containerID="cri-o://d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a" gracePeriod=30
Jul 17 22:06:53.573087 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.573023    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:53.750280 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.750238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") pod \"cf1d275f-0aea-430f-b728-31a4e89342d8\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") "
Jul 17 22:06:53.750449 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.750295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca\") pod \"cf1d275f-0aea-430f-b728-31a4e89342d8\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") "
Jul 17 22:06:53.750491 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.750466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzc4l\" (UniqueName: \"kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l\") pod \"cf1d275f-0aea-430f-b728-31a4e89342d8\" (UID: \"cf1d275f-0aea-430f-b728-31a4e89342d8\") "
Jul 17 22:06:53.750676 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.750652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf1d275f-0aea-430f-b728-31a4e89342d8" (UID: "cf1d275f-0aea-430f-b728-31a4e89342d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:06:53.750823 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.750801    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d275f-0aea-430f-b728-31a4e89342d8-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:53.752572 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.752544    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf1d275f-0aea-430f-b728-31a4e89342d8" (UID: "cf1d275f-0aea-430f-b728-31a4e89342d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:06:53.752657 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.752599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l" (OuterVolumeSpecName: "kube-api-access-kzc4l") pod "cf1d275f-0aea-430f-b728-31a4e89342d8" (UID: "cf1d275f-0aea-430f-b728-31a4e89342d8"). InnerVolumeSpecName "kube-api-access-kzc4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:06:53.786734 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.786706    2579 generic.go:356] "Generic (PLEG): container finished" podID="cf1d275f-0aea-430f-b728-31a4e89342d8" containerID="d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a" exitCode=0
Jul 17 22:06:53.786864 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.786739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" event={"ID":"cf1d275f-0aea-430f-b728-31a4e89342d8","Type":"ContainerDied","Data":"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"}
Jul 17 22:06:53.786864 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.786758    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"
Jul 17 22:06:53.786864 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.786794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh" event={"ID":"cf1d275f-0aea-430f-b728-31a4e89342d8","Type":"ContainerDied","Data":"a21021fde9b4355977cef15949083cd8c3cc8e31a651d9a861986257e166e80d"}
Jul 17 22:06:53.786864 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.786816    2579 scope.go:117] "RemoveContainer" containerID="d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"
Jul 17 22:06:53.795407 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.795385    2579 scope.go:117] "RemoveContainer" containerID="d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"
Jul 17 22:06:53.795680 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:06:53.795658    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a\": container with ID starting with d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a not found: ID does not exist" containerID="d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"
Jul 17 22:06:53.795759 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.795693    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a"} err="failed to get container status \"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a\": rpc error: code = NotFound desc = could not find container \"d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a\": container with ID starting with d8168978ff40a2a5cc4e5d510b9b5662cbc1e52b457397ee49de2f76b2e6011a not found: ID does not exist"
Jul 17 22:06:53.805327 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.805286    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:53.808288 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.808263    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92c219-8b78d5cd-qc6nh"]
Jul 17 22:06:53.851479 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.851390    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzc4l\" (UniqueName: \"kubernetes.io/projected/cf1d275f-0aea-430f-b728-31a4e89342d8-kube-api-access-kzc4l\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:53.851479 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:53.851423    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf1d275f-0aea-430f-b728-31a4e89342d8-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:06:55.765972 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:06:55.764448    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1d275f-0aea-430f-b728-31a4e89342d8" path="/var/lib/kubelet/pods/cf1d275f-0aea-430f-b728-31a4e89342d8/volumes"
Jul 17 22:07:13.248994 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.248954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:07:13.249432 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249405    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1d275f-0aea-430f-b728-31a4e89342d8" containerName="maas-api"
Jul 17 22:07:13.249432 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249417    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1d275f-0aea-430f-b728-31a4e89342d8" containerName="maas-api"
Jul 17 22:07:13.249508 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249440    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" containerName="maas-api"
Jul 17 22:07:13.249508 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249445    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" containerName="maas-api"
Jul 17 22:07:13.249571 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249512    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3477c63-d0a5-47fe-b8b5-76bfa0888266" containerName="maas-api"
Jul 17 22:07:13.249571 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.249525    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1d275f-0aea-430f-b728-31a4e89342d8" containerName="maas-api"
Jul 17 22:07:13.253963 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.253944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.258664 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.258640    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-2a645a-serving-cert\""
Jul 17 22:07:13.275049 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.275017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:07:13.339434 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.339396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.339434 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.339437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.339647 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.339517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lflh\" (UniqueName: \"kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.440449 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.440414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lflh\" (UniqueName: \"kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.440669 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.440518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.440669 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.440545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.441183 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.441163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.443279 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.443251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.449074 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.449047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lflh\" (UniqueName: \"kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh\") pod \"maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.563612 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.563578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:13.707430 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.707402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:07:13.709669 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:07:13.709634    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf17fa28_4d91_4d4c_a56c_3426764dd619.slice/crio-e80564f8a874860147e7d86576a9907283c2ad68e40a0120242e75edeab563ed WatchSource:0}: Error finding container e80564f8a874860147e7d86576a9907283c2ad68e40a0120242e75edeab563ed: Status 404 returned error can't find the container with id e80564f8a874860147e7d86576a9907283c2ad68e40a0120242e75edeab563ed
Jul 17 22:07:13.885928 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:13.885835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" event={"ID":"af17fa28-4d91-4d4c-a56c-3426764dd619","Type":"ContainerStarted","Data":"e80564f8a874860147e7d86576a9907283c2ad68e40a0120242e75edeab563ed"}
Jul 17 22:07:14.893017 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:14.892963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" event={"ID":"af17fa28-4d91-4d4c-a56c-3426764dd619","Type":"ContainerStarted","Data":"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"}
Jul 17 22:07:14.893486 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:14.893044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:14.911388 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:14.911331    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" podStartSLOduration=1.474154707 podStartE2EDuration="1.911315268s" totalImagesPullingTime="437.160561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:07:14.910742929 +0000 UTC m=+3001.692002664" watchObservedRunningTime="2026-07-17 22:07:14.911315268 +0000 UTC m=+3001.692574994"
Jul 17 22:07:20.902977 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:20.902944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:07:21.270211 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.270172    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:07:21.274143 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.274122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.276755 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.276729    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b96f25-serving-cert\""
Jul 17 22:07:21.284906 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.284880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:07:21.422598 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.422557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.422820 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.422625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9jg\" (UniqueName: \"kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.422820 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.422671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.524369 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.524273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.524369 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.524333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9jg\" (UniqueName: \"kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.524369 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.524367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.524596 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:07:21.524439    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-serving-cert: secret "maas-api-e2e-shared-b-b96f25-serving-cert" not found
Jul 17 22:07:21.524596 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:07:21.524520    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls podName:4f2c7234-c649-4924-b9b1-7a6fdea6fd12 nodeName:}" failed. No retries permitted until 2026-07-17 22:07:22.024500242 +0000 UTC m=+3008.805759947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls") pod "maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" (UID: "4f2c7234-c649-4924-b9b1-7a6fdea6fd12") : secret "maas-api-e2e-shared-b-b96f25-serving-cert" not found
Jul 17 22:07:21.525113 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.525096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:21.533470 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:21.533439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9jg\" (UniqueName: \"kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:22.029311 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.029281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:22.031909 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.031885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") pod \"maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:22.186235 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.186197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:22.324717 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.324689    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:07:22.327434 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:07:22.327400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2c7234_c649_4924_b9b1_7a6fdea6fd12.slice/crio-ca5486d2587f93993539e2de163454fc6c4710d21a5864b5c24cebf0215396a5 WatchSource:0}: Error finding container ca5486d2587f93993539e2de163454fc6c4710d21a5864b5c24cebf0215396a5: Status 404 returned error can't find the container with id ca5486d2587f93993539e2de163454fc6c4710d21a5864b5c24cebf0215396a5
Jul 17 22:07:22.937464 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.937376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" event={"ID":"4f2c7234-c649-4924-b9b1-7a6fdea6fd12","Type":"ContainerStarted","Data":"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"}
Jul 17 22:07:22.937464 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.937464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" event={"ID":"4f2c7234-c649-4924-b9b1-7a6fdea6fd12","Type":"ContainerStarted","Data":"ca5486d2587f93993539e2de163454fc6c4710d21a5864b5c24cebf0215396a5"}
Jul 17 22:07:22.937824 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.937485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:07:22.956903 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:22.956848    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" podStartSLOduration=1.653537198 podStartE2EDuration="1.956833579s" totalImagesPullingTime="303.296381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:07:22.954412963 +0000 UTC m=+3009.735672690" watchObservedRunningTime="2026-07-17 22:07:22.956833579 +0000 UTC m=+3009.738093305"
Jul 17 22:07:28.947624 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:07:28.947596    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:09:36.041262 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.041173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:36.045163 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.045139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:36.047757 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.047728    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5s65w\""
Jul 17 22:09:36.052852 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.052575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:36.132197 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.132159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwzq\" (UniqueName: \"kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq\") pod \"kuadrant-operator-catalog-ql7fr\" (UID: \"35b52f45-85f7-47bc-877c-b2fc14fed7db\") " pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:36.233090 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.233035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwzq\" (UniqueName: \"kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq\") pod \"kuadrant-operator-catalog-ql7fr\" (UID: \"35b52f45-85f7-47bc-877c-b2fc14fed7db\") " pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:36.242020 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.241989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwzq\" (UniqueName: \"kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq\") pod \"kuadrant-operator-catalog-ql7fr\" (UID: \"35b52f45-85f7-47bc-877c-b2fc14fed7db\") " pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:36.355985 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.355884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:36.494192 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.494166    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:36.495491 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:09:36.495467    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b52f45_85f7_47bc_877c_b2fc14fed7db.slice/crio-6d433804ba719b6775d89b6969b4bf0d62472cb2508958b8d436bc57649aefcd WatchSource:0}: Error finding container 6d433804ba719b6775d89b6969b4bf0d62472cb2508958b8d436bc57649aefcd: Status 404 returned error can't find the container with id 6d433804ba719b6775d89b6969b4bf0d62472cb2508958b8d436bc57649aefcd
Jul 17 22:09:36.598599 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:36.598561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" event={"ID":"35b52f45-85f7-47bc-877c-b2fc14fed7db","Type":"ContainerStarted","Data":"6d433804ba719b6775d89b6969b4bf0d62472cb2508958b8d436bc57649aefcd"}
Jul 17 22:09:38.611385 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:38.611284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" event={"ID":"35b52f45-85f7-47bc-877c-b2fc14fed7db","Type":"ContainerStarted","Data":"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"}
Jul 17 22:09:38.629237 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:38.629178    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" podStartSLOduration=0.857152109 podStartE2EDuration="2.629162244s" totalImagesPullingTime="1.772010135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:38.626416124 +0000 UTC m=+3145.407675851" watchObservedRunningTime="2026-07-17 22:09:38.629162244 +0000 UTC m=+3145.410421971"
Jul 17 22:09:46.356536 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:46.356493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:46.357018 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:46.356552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:46.382207 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:46.382180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:46.675584 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:46.675507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:46.710805 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:46.710754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:48.662978 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:48.662937    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" podUID="35b52f45-85f7-47bc-877c-b2fc14fed7db" containerName="registry-server" containerID="cri-o://413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c" gracePeriod=2
Jul 17 22:09:48.922233 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:48.922173    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:49.058559 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.058520    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwzq\" (UniqueName: \"kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq\") pod \"35b52f45-85f7-47bc-877c-b2fc14fed7db\" (UID: \"35b52f45-85f7-47bc-877c-b2fc14fed7db\") "
Jul 17 22:09:49.060780 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.060735    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq" (OuterVolumeSpecName: "kube-api-access-nbwzq") pod "35b52f45-85f7-47bc-877c-b2fc14fed7db" (UID: "35b52f45-85f7-47bc-877c-b2fc14fed7db"). InnerVolumeSpecName "kube-api-access-nbwzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:09:49.159651 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.159607    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbwzq\" (UniqueName: \"kubernetes.io/projected/35b52f45-85f7-47bc-877c-b2fc14fed7db-kube-api-access-nbwzq\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:09:49.668390 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.668353    2579 generic.go:356] "Generic (PLEG): container finished" podID="35b52f45-85f7-47bc-877c-b2fc14fed7db" containerID="413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c" exitCode=0
Jul 17 22:09:49.668871 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.668403    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr"
Jul 17 22:09:49.668871 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.668445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" event={"ID":"35b52f45-85f7-47bc-877c-b2fc14fed7db","Type":"ContainerDied","Data":"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"}
Jul 17 22:09:49.668871 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.668499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ql7fr" event={"ID":"35b52f45-85f7-47bc-877c-b2fc14fed7db","Type":"ContainerDied","Data":"6d433804ba719b6775d89b6969b4bf0d62472cb2508958b8d436bc57649aefcd"}
Jul 17 22:09:49.668871 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.668521    2579 scope.go:117] "RemoveContainer" containerID="413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"
Jul 17 22:09:49.678559 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.678540    2579 scope.go:117] "RemoveContainer" containerID="413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"
Jul 17 22:09:49.678823 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:09:49.678802    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c\": container with ID starting with 413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c not found: ID does not exist" containerID="413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"
Jul 17 22:09:49.678879 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.678833    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c"} err="failed to get container status \"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c\": rpc error: code = NotFound desc = could not find container \"413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c\": container with ID starting with 413c8380f05ca8cd4d2cc1faf164c9781a9600caa09084af55d3190b97cb468c not found: ID does not exist"
Jul 17 22:09:49.690267 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.690230    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:49.698835 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.696801    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ql7fr"]
Jul 17 22:09:49.763317 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:09:49.763275    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b52f45-85f7-47bc-877c-b2fc14fed7db" path="/var/lib/kubelet/pods/35b52f45-85f7-47bc-877c-b2fc14fed7db/volumes"
Jul 17 22:13:11.158449 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.158413    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7513-139902992673712"]
Jul 17 22:13:11.158910 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.158863    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b52f45-85f7-47bc-877c-b2fc14fed7db" containerName="registry-server"
Jul 17 22:13:11.158910 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.158876    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b52f45-85f7-47bc-877c-b2fc14fed7db" containerName="registry-server"
Jul 17 22:13:11.158989 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.158959    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b52f45-85f7-47bc-877c-b2fc14fed7db" containerName="registry-server"
Jul 17 22:13:11.162106 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.162090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:11.164944 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.164915    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s7gsx\""
Jul 17 22:13:11.168448 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.168422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992673712"]
Jul 17 22:13:11.326219 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.326186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rclgf\" (UniqueName: \"kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf\") pod \"test-curl-7513-139902992673712\" (UID: \"0a16f45b-15c8-4a60-a98b-7cdca65bc911\") " pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:11.427295 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.427191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rclgf\" (UniqueName: \"kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf\") pod \"test-curl-7513-139902992673712\" (UID: \"0a16f45b-15c8-4a60-a98b-7cdca65bc911\") " pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:11.435425 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.435392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rclgf\" (UniqueName: \"kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf\") pod \"test-curl-7513-139902992673712\" (UID: \"0a16f45b-15c8-4a60-a98b-7cdca65bc911\") " pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:11.473489 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.473454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:11.612519 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.612490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992673712"]
Jul 17 22:13:11.613682 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:13:11.613656    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a16f45b_15c8_4a60_a98b_7cdca65bc911.slice/crio-bb097054bb5ee43c7f5fc049663fd8c4f926b7b78f24324dde6d61f231a6dcbf WatchSource:0}: Error finding container bb097054bb5ee43c7f5fc049663fd8c4f926b7b78f24324dde6d61f231a6dcbf: Status 404 returned error can't find the container with id bb097054bb5ee43c7f5fc049663fd8c4f926b7b78f24324dde6d61f231a6dcbf
Jul 17 22:13:11.614998 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.614977    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 22:13:11.674696 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:11.674666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992673712" event={"ID":"0a16f45b-15c8-4a60-a98b-7cdca65bc911","Type":"ContainerStarted","Data":"bb097054bb5ee43c7f5fc049663fd8c4f926b7b78f24324dde6d61f231a6dcbf"}
Jul 17 22:13:12.681044 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:12.680959    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" containerID="44aa2d93e4ee95d34b05271881fd98ab35ebb15e79f3686b69f69d580063ea77" exitCode=0
Jul 17 22:13:12.681392 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:12.681047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992673712" event={"ID":"0a16f45b-15c8-4a60-a98b-7cdca65bc911","Type":"ContainerDied","Data":"44aa2d93e4ee95d34b05271881fd98ab35ebb15e79f3686b69f69d580063ea77"}
Jul 17 22:13:13.836712 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.836685    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:13.849476 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.849447    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rclgf\" (UniqueName: \"kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf\") pod \"0a16f45b-15c8-4a60-a98b-7cdca65bc911\" (UID: \"0a16f45b-15c8-4a60-a98b-7cdca65bc911\") "
Jul 17 22:13:13.851992 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.851955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf" (OuterVolumeSpecName: "kube-api-access-rclgf") pod "0a16f45b-15c8-4a60-a98b-7cdca65bc911" (UID: "0a16f45b-15c8-4a60-a98b-7cdca65bc911"). InnerVolumeSpecName "kube-api-access-rclgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:13.873729 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.873696    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7513-139902992673712_0a16f45b-15c8-4a60-a98b-7cdca65bc911/test-curl-7513-139902992673712/0.log"
Jul 17 22:13:13.898973 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.898940    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7513-139902992673712"]
Jul 17 22:13:13.903239 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.903213    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7513-139902992673712"]
Jul 17 22:13:13.950895 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:13.950803    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rclgf\" (UniqueName: \"kubernetes.io/projected/0a16f45b-15c8-4a60-a98b-7cdca65bc911-kube-api-access-rclgf\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:14.026703 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.026668    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7513-139902992673840"]
Jul 17 22:13:14.027144 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.027130    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" containerName="test-curl-7513-139902992673712"
Jul 17 22:13:14.027191 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.027145    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" containerName="test-curl-7513-139902992673712"
Jul 17 22:13:14.027226 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.027217    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" containerName="test-curl-7513-139902992673712"
Jul 17 22:13:14.030355 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.030337    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:14.034787 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.034749    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992673840"]
Jul 17 22:13:14.052286 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.052249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7fl\" (UniqueName: \"kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl\") pod \"test-curl-7513-139902992673840\" (UID: \"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee\") " pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:14.153607 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.153569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7fl\" (UniqueName: \"kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl\") pod \"test-curl-7513-139902992673840\" (UID: \"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee\") " pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:14.162141 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.162114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7fl\" (UniqueName: \"kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl\") pod \"test-curl-7513-139902992673840\" (UID: \"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee\") " pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:14.342110 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.342077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:14.475047 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:13:14.475015    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode74b9cbc_cec3_4ef0_b5f0_4d4d371d35ee.slice/crio-56b4d0535c87f5ef32ba1429ec63cecb0c6c2f1eefa6e9886646ea534816d8aa WatchSource:0}: Error finding container 56b4d0535c87f5ef32ba1429ec63cecb0c6c2f1eefa6e9886646ea534816d8aa: Status 404 returned error can't find the container with id 56b4d0535c87f5ef32ba1429ec63cecb0c6c2f1eefa6e9886646ea534816d8aa
Jul 17 22:13:14.475598 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.475574    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992673840"]
Jul 17 22:13:14.692125 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.692035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992673840" event={"ID":"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee","Type":"ContainerStarted","Data":"56b4d0535c87f5ef32ba1429ec63cecb0c6c2f1eefa6e9886646ea534816d8aa"}
Jul 17 22:13:14.693269 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.693247    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb097054bb5ee43c7f5fc049663fd8c4f926b7b78f24324dde6d61f231a6dcbf"
Jul 17 22:13:14.693269 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:14.693261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:14.703518 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:13:14.703491    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7513-139902992673712\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:15.699961 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:15.699921    2579 generic.go:356] "Generic (PLEG): container finished" podID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" containerID="d2d80acd3674a6094acf718036aa7183367eb198bf1d697a1e779d1595057a5c" exitCode=0
Jul 17 22:13:15.700327 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:15.700008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992673840" event={"ID":"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee","Type":"ContainerDied","Data":"d2d80acd3674a6094acf718036aa7183367eb198bf1d697a1e779d1595057a5c"}
Jul 17 22:13:15.702532 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:13:15.702491    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7513-139902992673712\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" pod="opendatahub/test-curl-7513-139902992673712"
Jul 17 22:13:15.763134 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:15.763099    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a16f45b-15c8-4a60-a98b-7cdca65bc911" path="/var/lib/kubelet/pods/0a16f45b-15c8-4a60-a98b-7cdca65bc911/volumes"
Jul 17 22:13:16.848208 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.848183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:16.870211 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.870179    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7513-139902992673840_e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee/test-curl-7513-139902992673840/0.log"
Jul 17 22:13:16.882464 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.882427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk7fl\" (UniqueName: \"kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl\") pod \"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee\" (UID: \"e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee\") "
Jul 17 22:13:16.884690 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.884658    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl" (OuterVolumeSpecName: "kube-api-access-hk7fl") pod "e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" (UID: "e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee"). InnerVolumeSpecName "kube-api-access-hk7fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:16.895406 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.895375    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7513-139902992673840"]
Jul 17 22:13:16.898971 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.898948    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7513-139902992673840"]
Jul 17 22:13:16.984336 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:16.984249    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk7fl\" (UniqueName: \"kubernetes.io/projected/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee-kube-api-access-hk7fl\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:17.051996 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.051960    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:17.052483 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.052463    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" containerName="test-curl-7513-139902992673840"
Jul 17 22:13:17.052574 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.052484    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" containerName="test-curl-7513-139902992673840"
Jul 17 22:13:17.052629 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.052571    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" containerName="test-curl-7513-139902992673840"
Jul 17 22:13:17.055893 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.055870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:17.065196 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.065170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:17.084810 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.084751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdkvq\" (UniqueName: \"kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq\") pod \"test-curl-7513-139902992823616\" (UID: \"3985df7d-1b8c-4ba6-b144-55e6af710fa9\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:17.185729 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.185699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdkvq\" (UniqueName: \"kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq\") pod \"test-curl-7513-139902992823616\" (UID: \"3985df7d-1b8c-4ba6-b144-55e6af710fa9\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:17.195157 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.195127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdkvq\" (UniqueName: \"kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq\") pod \"test-curl-7513-139902992823616\" (UID: \"3985df7d-1b8c-4ba6-b144-55e6af710fa9\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:17.366936 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.366889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:17.511708 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.511679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:17.512921 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:13:17.512891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3985df7d_1b8c_4ba6_b144_55e6af710fa9.slice/crio-4c73ecfe896264e847c51a2a79045ce3b5fba90bbc8db3ff7afd10b6debc7337 WatchSource:0}: Error finding container 4c73ecfe896264e847c51a2a79045ce3b5fba90bbc8db3ff7afd10b6debc7337: Status 404 returned error can't find the container with id 4c73ecfe896264e847c51a2a79045ce3b5fba90bbc8db3ff7afd10b6debc7337
Jul 17 22:13:17.712141 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.712050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:17.712303 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.712061    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56b4d0535c87f5ef32ba1429ec63cecb0c6c2f1eefa6e9886646ea534816d8aa"
Jul 17 22:13:17.713326 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.713302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992823616" event={"ID":"3985df7d-1b8c-4ba6-b144-55e6af710fa9","Type":"ContainerStarted","Data":"4c73ecfe896264e847c51a2a79045ce3b5fba90bbc8db3ff7afd10b6debc7337"}
Jul 17 22:13:17.722635 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:13:17.722606    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7513-139902992673840\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" pod="opendatahub/test-curl-7513-139902992673840"
Jul 17 22:13:17.763156 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:17.763119    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee" path="/var/lib/kubelet/pods/e74b9cbc-cec3-4ef0-b5f0-4d4d371d35ee/volumes"
Jul 17 22:13:18.719348 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:18.719310    2579 generic.go:356] "Generic (PLEG): container finished" podID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" containerID="3e7c1a32a7d294c126b54d13fd81cef9077d652fefcdd78d9be1819bdc3bb7b7" exitCode=0
Jul 17 22:13:18.719741 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:18.719359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992823616" event={"ID":"3985df7d-1b8c-4ba6-b144-55e6af710fa9","Type":"ContainerDied","Data":"3e7c1a32a7d294c126b54d13fd81cef9077d652fefcdd78d9be1819bdc3bb7b7"}
Jul 17 22:13:19.864209 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.864183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:19.885176 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.885150    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7513-139902992823616_3985df7d-1b8c-4ba6-b144-55e6af710fa9/test-curl-7513-139902992823616/0.log"
Jul 17 22:13:19.917658 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.910898    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:19.917658 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.917467    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdkvq\" (UniqueName: \"kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq\") pod \"3985df7d-1b8c-4ba6-b144-55e6af710fa9\" (UID: \"3985df7d-1b8c-4ba6-b144-55e6af710fa9\") "
Jul 17 22:13:19.919928 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.919895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq" (OuterVolumeSpecName: "kube-api-access-vdkvq") pod "3985df7d-1b8c-4ba6-b144-55e6af710fa9" (UID: "3985df7d-1b8c-4ba6-b144-55e6af710fa9"). InnerVolumeSpecName "kube-api-access-vdkvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:19.921582 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:19.921558    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:20.018935 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.018903    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdkvq\" (UniqueName: \"kubernetes.io/projected/3985df7d-1b8c-4ba6-b144-55e6af710fa9-kube-api-access-vdkvq\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:20.036571 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.036534    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:20.037008 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.036993    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:20.037060 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.037010    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:20.037095 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.037076    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:20.040151 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.040134    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.045733 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.045700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:20.120309 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.120266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqpn7\" (UniqueName: \"kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7\") pod \"test-curl-7513-139902992823616\" (UID: \"ef8419da-d752-4547-a6f8-39686a9c5292\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.221636 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.221595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqpn7\" (UniqueName: \"kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7\") pod \"test-curl-7513-139902992823616\" (UID: \"ef8419da-d752-4547-a6f8-39686a9c5292\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.230730 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.230707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqpn7\" (UniqueName: \"kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7\") pod \"test-curl-7513-139902992823616\" (UID: \"ef8419da-d752-4547-a6f8-39686a9c5292\") " pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.350934 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.350849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.489698 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.489669    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:20.491447 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:13:20.491421    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef8419da_d752_4547_a6f8_39686a9c5292.slice/crio-48775c954c1da3c43d1ae9cdabcd66fe469d08cba301d03c866f144f4ebea274 WatchSource:0}: Error finding container 48775c954c1da3c43d1ae9cdabcd66fe469d08cba301d03c866f144f4ebea274: Status 404 returned error can't find the container with id 48775c954c1da3c43d1ae9cdabcd66fe469d08cba301d03c866f144f4ebea274
Jul 17 22:13:20.731495 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.731389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992823616" event={"ID":"ef8419da-d752-4547-a6f8-39686a9c5292","Type":"ContainerStarted","Data":"48775c954c1da3c43d1ae9cdabcd66fe469d08cba301d03c866f144f4ebea274"}
Jul 17 22:13:20.732694 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.732672    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c73ecfe896264e847c51a2a79045ce3b5fba90bbc8db3ff7afd10b6debc7337"
Jul 17 22:13:20.732847 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.732731    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:20.744278 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:20.744249    2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7513-139902992823616" oldPodUID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" podUID="ef8419da-d752-4547-a6f8-39686a9c5292"
Jul 17 22:13:21.739693 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:21.739655    2579 generic.go:356] "Generic (PLEG): container finished" podID="ef8419da-d752-4547-a6f8-39686a9c5292" containerID="823637663d6afd9660e30378bcd28f1d507a39a120c082ad76edfac2fc830aea" exitCode=0
Jul 17 22:13:21.740180 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:21.739740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992823616" event={"ID":"ef8419da-d752-4547-a6f8-39686a9c5292","Type":"ContainerDied","Data":"823637663d6afd9660e30378bcd28f1d507a39a120c082ad76edfac2fc830aea"}
Jul 17 22:13:21.763870 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:21.763839    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3985df7d-1b8c-4ba6-b144-55e6af710fa9" path="/var/lib/kubelet/pods/3985df7d-1b8c-4ba6-b144-55e6af710fa9/volumes"
Jul 17 22:13:22.881153 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.881128    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:22.900990 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.900960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7513-139902992823616_ef8419da-d752-4547-a6f8-39686a9c5292/test-curl-7513-139902992823616/0.log"
Jul 17 22:13:22.924204 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.924176    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:22.929909 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.929885    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7513-139902992823616"]
Jul 17 22:13:22.950195 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.950171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqpn7\" (UniqueName: \"kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7\") pod \"ef8419da-d752-4547-a6f8-39686a9c5292\" (UID: \"ef8419da-d752-4547-a6f8-39686a9c5292\") "
Jul 17 22:13:22.952209 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:22.952189    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7" (OuterVolumeSpecName: "kube-api-access-qqpn7") pod "ef8419da-d752-4547-a6f8-39686a9c5292" (UID: "ef8419da-d752-4547-a6f8-39686a9c5292"). InnerVolumeSpecName "kube-api-access-qqpn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:23.051809 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.051748    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqpn7\" (UniqueName: \"kubernetes.io/projected/ef8419da-d752-4547-a6f8-39686a9c5292-kube-api-access-qqpn7\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:23.053910 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.053888    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7513-139902992824624"]
Jul 17 22:13:23.054318 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.054306    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8419da-d752-4547-a6f8-39686a9c5292" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:23.054365 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.054320    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8419da-d752-4547-a6f8-39686a9c5292" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:23.054404 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.054387    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8419da-d752-4547-a6f8-39686a9c5292" containerName="test-curl-7513-139902992823616"
Jul 17 22:13:23.057404 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.057386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:23.066421 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.066391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992824624"]
Jul 17 22:13:23.152611 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.152562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q76n\" (UniqueName: \"kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n\") pod \"test-curl-7513-139902992824624\" (UID: \"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0\") " pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:23.253390 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.253348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q76n\" (UniqueName: \"kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n\") pod \"test-curl-7513-139902992824624\" (UID: \"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0\") " pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:23.262462 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.262431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q76n\" (UniqueName: \"kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n\") pod \"test-curl-7513-139902992824624\" (UID: \"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0\") " pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:23.376648 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.376562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:23.535431 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.535403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7513-139902992824624"]
Jul 17 22:13:23.536826 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:13:23.536751    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb9ffa0_9fbb_4a76_bbf0_2e84d84999c0.slice/crio-a52c373735b37f824a56a11f4664af8730d26a43aa0cff1d89b6c3e0eae0a7b4 WatchSource:0}: Error finding container a52c373735b37f824a56a11f4664af8730d26a43aa0cff1d89b6c3e0eae0a7b4: Status 404 returned error can't find the container with id a52c373735b37f824a56a11f4664af8730d26a43aa0cff1d89b6c3e0eae0a7b4
Jul 17 22:13:23.753223 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.753129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992824624" event={"ID":"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0","Type":"ContainerStarted","Data":"a52c373735b37f824a56a11f4664af8730d26a43aa0cff1d89b6c3e0eae0a7b4"}
Jul 17 22:13:23.754400 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.754373    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48775c954c1da3c43d1ae9cdabcd66fe469d08cba301d03c866f144f4ebea274"
Jul 17 22:13:23.754554 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.754401    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992823616"
Jul 17 22:13:23.762303 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:23.762276    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8419da-d752-4547-a6f8-39686a9c5292" path="/var/lib/kubelet/pods/ef8419da-d752-4547-a6f8-39686a9c5292/volumes"
Jul 17 22:13:24.761325 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:24.761289    2579 generic.go:356] "Generic (PLEG): container finished" podID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" containerID="e59b6d975396c38035d4b881494aa6d2607f47b94f3d45b447ac26bd1cc0a580" exitCode=0
Jul 17 22:13:24.761723 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:24.761384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7513-139902992824624" event={"ID":"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0","Type":"ContainerDied","Data":"e59b6d975396c38035d4b881494aa6d2607f47b94f3d45b447ac26bd1cc0a580"}
Jul 17 22:13:25.905103 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.905079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:25.926584 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.926557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7513-139902992824624_4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0/test-curl-7513-139902992824624/0.log"
Jul 17 22:13:25.951618 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.951585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7513-139902992824624"]
Jul 17 22:13:25.956226 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.956198    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7513-139902992824624"]
Jul 17 22:13:25.979126 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.979096    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q76n\" (UniqueName: \"kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n\") pod \"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0\" (UID: \"4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0\") "
Jul 17 22:13:25.981157 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:25.981128    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n" (OuterVolumeSpecName: "kube-api-access-2q76n") pod "4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" (UID: "4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0"). InnerVolumeSpecName "kube-api-access-2q76n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:26.080552 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:26.080468    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q76n\" (UniqueName: \"kubernetes.io/projected/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0-kube-api-access-2q76n\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:26.772856 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:26.772824    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:26.772856 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:26.772844    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a52c373735b37f824a56a11f4664af8730d26a43aa0cff1d89b6c3e0eae0a7b4"
Jul 17 22:13:26.782428 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:13:26.782400    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7513-139902992824624\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" pod="opendatahub/test-curl-7513-139902992824624"
Jul 17 22:13:27.762994 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:27.762960    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" path="/var/lib/kubelet/pods/4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0/volumes"
Jul 17 22:13:39.688721 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:39.688684    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:13:39.689233 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:39.688993    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" podUID="af17fa28-4d91-4d4c-a56c-3426764dd619" containerName="maas-api" containerID="cri-o://d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8" gracePeriod=30
Jul 17 22:13:40.144058 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.144034    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:13:40.318705 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.318674    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lflh\" (UniqueName: \"kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh\") pod \"af17fa28-4d91-4d4c-a56c-3426764dd619\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") "
Jul 17 22:13:40.318931 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.318760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca\") pod \"af17fa28-4d91-4d4c-a56c-3426764dd619\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") "
Jul 17 22:13:40.318931 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.318840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls\") pod \"af17fa28-4d91-4d4c-a56c-3426764dd619\" (UID: \"af17fa28-4d91-4d4c-a56c-3426764dd619\") "
Jul 17 22:13:40.319109 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.319085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af17fa28-4d91-4d4c-a56c-3426764dd619" (UID: "af17fa28-4d91-4d4c-a56c-3426764dd619"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:13:40.321048 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.321015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af17fa28-4d91-4d4c-a56c-3426764dd619" (UID: "af17fa28-4d91-4d4c-a56c-3426764dd619"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:13:40.321048 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.321040    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh" (OuterVolumeSpecName: "kube-api-access-4lflh") pod "af17fa28-4d91-4d4c-a56c-3426764dd619" (UID: "af17fa28-4d91-4d4c-a56c-3426764dd619"). InnerVolumeSpecName "kube-api-access-4lflh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:13:40.419628 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.419590    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af17fa28-4d91-4d4c-a56c-3426764dd619-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:40.419628 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.419622    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af17fa28-4d91-4d4c-a56c-3426764dd619-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:40.419628 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.419631    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lflh\" (UniqueName: \"kubernetes.io/projected/af17fa28-4d91-4d4c-a56c-3426764dd619-kube-api-access-4lflh\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:13:40.854924 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.854892    2579 generic.go:356] "Generic (PLEG): container finished" podID="af17fa28-4d91-4d4c-a56c-3426764dd619" containerID="d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8" exitCode=0
Jul 17 22:13:40.855342 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.854961    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"
Jul 17 22:13:40.855342 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.854985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" event={"ID":"af17fa28-4d91-4d4c-a56c-3426764dd619","Type":"ContainerDied","Data":"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"}
Jul 17 22:13:40.855342 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.855066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l" event={"ID":"af17fa28-4d91-4d4c-a56c-3426764dd619","Type":"ContainerDied","Data":"e80564f8a874860147e7d86576a9907283c2ad68e40a0120242e75edeab563ed"}
Jul 17 22:13:40.855342 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.855089    2579 scope.go:117] "RemoveContainer" containerID="d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"
Jul 17 22:13:40.864367 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.864350    2579 scope.go:117] "RemoveContainer" containerID="d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"
Jul 17 22:13:40.864641 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:13:40.864621    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8\": container with ID starting with d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8 not found: ID does not exist" containerID="d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"
Jul 17 22:13:40.864690 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.864651    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8"} err="failed to get container status \"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8\": rpc error: code = NotFound desc = could not find container \"d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8\": container with ID starting with d990c2838bdee262074f4a5eeeb13dcbe6cbe063a8870c707e3f52c091b5c1b8 not found: ID does not exist"
Jul 17 22:13:40.878151 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.878122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:13:40.882125 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:40.882104    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2a645a-cb7767cf9-9976l"]
Jul 17 22:13:41.764585 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:13:41.764548    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af17fa28-4d91-4d4c-a56c-3426764dd619" path="/var/lib/kubelet/pods/af17fa28-4d91-4d4c-a56c-3426764dd619/volumes"
Jul 17 22:14:05.805491 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:05.805372    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:14:05.805984 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:05.805621    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" podUID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" containerName="maas-api" containerID="cri-o://4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8" gracePeriod=30
Jul 17 22:14:06.258633 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.258604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:14:06.364078 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.363978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca\") pod \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") "
Jul 17 22:14:06.364078 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.364056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") pod \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") "
Jul 17 22:14:06.364263 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.364093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt9jg\" (UniqueName: \"kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg\") pod \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\" (UID: \"4f2c7234-c649-4924-b9b1-7a6fdea6fd12\") "
Jul 17 22:14:06.364413 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.364385    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f2c7234-c649-4924-b9b1-7a6fdea6fd12" (UID: "4f2c7234-c649-4924-b9b1-7a6fdea6fd12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:14:06.366340 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.366319    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f2c7234-c649-4924-b9b1-7a6fdea6fd12" (UID: "4f2c7234-c649-4924-b9b1-7a6fdea6fd12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:14:06.366410 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.366343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg" (OuterVolumeSpecName: "kube-api-access-nt9jg") pod "4f2c7234-c649-4924-b9b1-7a6fdea6fd12" (UID: "4f2c7234-c649-4924-b9b1-7a6fdea6fd12"). InnerVolumeSpecName "kube-api-access-nt9jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:14:06.465696 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.465654    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:14:06.465696 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.465690    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:14:06.465696 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.465702    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt9jg\" (UniqueName: \"kubernetes.io/projected/4f2c7234-c649-4924-b9b1-7a6fdea6fd12-kube-api-access-nt9jg\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 17 22:14:06.995317 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.995280    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" containerID="4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8" exitCode=0
Jul 17 22:14:06.995790 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.995329    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"
Jul 17 22:14:06.995790 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.995370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" event={"ID":"4f2c7234-c649-4924-b9b1-7a6fdea6fd12","Type":"ContainerDied","Data":"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"}
Jul 17 22:14:06.995790 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.995433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw" event={"ID":"4f2c7234-c649-4924-b9b1-7a6fdea6fd12","Type":"ContainerDied","Data":"ca5486d2587f93993539e2de163454fc6c4710d21a5864b5c24cebf0215396a5"}
Jul 17 22:14:06.995790 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:06.995465    2579 scope.go:117] "RemoveContainer" containerID="4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"
Jul 17 22:14:07.011026 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:07.011005    2579 scope.go:117] "RemoveContainer" containerID="4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"
Jul 17 22:14:07.011402 ip-10-0-128-177 kubenswrapper[2579]: E0717 22:14:07.011376    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8\": container with ID starting with 4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8 not found: ID does not exist" containerID="4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"
Jul 17 22:14:07.011520 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:07.011404    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8"} err="failed to get container status \"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8\": rpc error: code = NotFound desc = could not find container \"4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8\": container with ID starting with 4a14b40579c4f6d537dc8d402446ba5bf4130851ca8bb2165a3b19be128b22c8 not found: ID does not exist"
Jul 17 22:14:07.023113 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:07.023083    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:14:07.026526 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:07.026500    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b96f25-5f564c4989-7hkcw"]
Jul 17 22:14:07.762737 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:07.762707    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" path="/var/lib/kubelet/pods/4f2c7234-c649-4924-b9b1-7a6fdea6fd12/volumes"
Jul 17 22:14:21.759123 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:21.759074    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55db48f599-87w9n_b35660fe-75e2-4acb-b418-0731a6637a50/authorino/0.log"
Jul 17 22:14:27.092683 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:27.092654    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bdd5689cb-46fq2_0e32303f-f47a-461e-9c11-2f27f3da8287/manager/0.log"
Jul 17 22:14:27.425826 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:27.425749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6dbd9688-tjpp6_1e2b6831-9412-41bd-a8d5-52c5efe397ea/copy-manifests/0.log"
Jul 17 22:14:27.437835 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:27.437810    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6dbd9688-tjpp6_1e2b6831-9412-41bd-a8d5-52c5efe397ea/manager/0.log"
Jul 17 22:14:28.027200 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:28.027175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b57b4884b-rldv2_2fa1cb12-233e-4373-a14e-35c14b97e703/maas-api/0.log"
Jul 17 22:14:30.641823 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:30.641795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55db48f599-87w9n_b35660fe-75e2-4acb-b418-0731a6637a50/authorino/0.log"
Jul 17 22:14:31.419827 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:31.419794    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rnhx4_c0858505-4ba4-4b94-a833-c64edc64120d/manager/0.log"
Jul 17 22:14:31.983686 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:31.983655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb8dc498-tghfg_fe852751-8f1c-40ea-ad62-d69b3e09bf3b/kube-auth-proxy/0.log"
Jul 17 22:14:32.318812 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:32.318747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-r8nbn_33197c48-fcc9-404f-969d-20c8c9d2c5fe/payload-pre-processing/0.log"
Jul 17 22:14:32.430560 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:32.430530    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-gjnzp_95d42920-d5b3-4726-a06c-15b23ed70ca4/payload-processing/0.log"
Jul 17 22:14:33.182988 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:33.182961    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzrp8s_a824a899-ef43-4e7f-9afb-c3757ce2d904/main/0.log"
Jul 17 22:14:38.402330 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402298    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjx6d/must-gather-7kg68"]
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402693    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" containerName="test-curl-7513-139902992824624"
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402704    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" containerName="test-curl-7513-139902992824624"
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" containerName="maas-api"
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402726    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" containerName="maas-api"
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402735    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af17fa28-4d91-4d4c-a56c-3426764dd619" containerName="maas-api"
Jul 17 22:14:38.402815 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402741    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="af17fa28-4d91-4d4c-a56c-3426764dd619" containerName="maas-api"
Jul 17 22:14:38.403006 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402853    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="af17fa28-4d91-4d4c-a56c-3426764dd619" containerName="maas-api"
Jul 17 22:14:38.403006 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2c7234-c649-4924-b9b1-7a6fdea6fd12" containerName="maas-api"
Jul 17 22:14:38.403006 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.402871    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb9ffa0-9fbb-4a76-bbf0-2e84d84999c0" containerName="test-curl-7513-139902992824624"
Jul 17 22:14:38.406063 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.406046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.408951 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.408927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjx6d\"/\"openshift-service-ca.crt\""
Jul 17 22:14:38.409088 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.408927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjx6d\"/\"kube-root-ca.crt\""
Jul 17 22:14:38.414813 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.414791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjx6d/must-gather-7kg68"]
Jul 17 22:14:38.463238 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.463203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-must-gather-output\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.463238 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.463243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqcjs\" (UniqueName: \"kubernetes.io/projected/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-kube-api-access-hqcjs\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.563877 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.563841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-must-gather-output\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.563877 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.563888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqcjs\" (UniqueName: \"kubernetes.io/projected/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-kube-api-access-hqcjs\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.564181 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.564158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-must-gather-output\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.573439 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.573410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqcjs\" (UniqueName: \"kubernetes.io/projected/efb7c2ab-aaa0-4850-bed1-22c809dc4b28-kube-api-access-hqcjs\") pod \"must-gather-7kg68\" (UID: \"efb7c2ab-aaa0-4850-bed1-22c809dc4b28\") " pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.716095 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.716002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjx6d/must-gather-7kg68"
Jul 17 22:14:38.852492 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:38.852461    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjx6d/must-gather-7kg68"]
Jul 17 22:14:38.853543 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:14:38.853516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefb7c2ab_aaa0_4850_bed1_22c809dc4b28.slice/crio-6073a3eb95e4e715a9d3733243266112536fd2b69027d6df03848d838576f719 WatchSource:0}: Error finding container 6073a3eb95e4e715a9d3733243266112536fd2b69027d6df03848d838576f719: Status 404 returned error can't find the container with id 6073a3eb95e4e715a9d3733243266112536fd2b69027d6df03848d838576f719
Jul 17 22:14:39.162995 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:39.162957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjx6d/must-gather-7kg68" event={"ID":"efb7c2ab-aaa0-4850-bed1-22c809dc4b28","Type":"ContainerStarted","Data":"6073a3eb95e4e715a9d3733243266112536fd2b69027d6df03848d838576f719"}
Jul 17 22:14:40.172852 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:40.172813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjx6d/must-gather-7kg68" event={"ID":"efb7c2ab-aaa0-4850-bed1-22c809dc4b28","Type":"ContainerStarted","Data":"d6dea0fe9441f1186428ace6e0fb25f4f511c44266a3fbce155879cd332193ac"}
Jul 17 22:14:40.173271 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:40.172862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjx6d/must-gather-7kg68" event={"ID":"efb7c2ab-aaa0-4850-bed1-22c809dc4b28","Type":"ContainerStarted","Data":"da810d129df9a57ae0b3a8dfcecc30e1d3cb2332485b5519dcd87c0e94099ac7"}
Jul 17 22:14:40.193139 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:40.193087    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gjx6d/must-gather-7kg68" podStartSLOduration=1.447795456 podStartE2EDuration="2.193069899s" totalImagesPullingTime="745.274443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:14:40.188974423 +0000 UTC m=+3446.970234151" watchObservedRunningTime="2026-07-17 22:14:40.193069899 +0000 UTC m=+3446.974329644"
Jul 17 22:14:41.153828 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:41.153794    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5vmtj_0f64e890-db24-4c2d-bdc6-35d0dac52b57/global-pull-secret-syncer/0.log"
Jul 17 22:14:41.355821 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:41.355785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-szzck_15e71d0c-1b82-4d68-8bb0-5101dc7cc546/konnectivity-agent/0.log"
Jul 17 22:14:41.378874 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:41.378831    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-177.ec2.internal_940dc9292c7a092fd2444fd3c4d9e071/haproxy/0.log"
Jul 17 22:14:46.904791 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:46.904196    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55db48f599-87w9n_b35660fe-75e2-4acb-b418-0731a6637a50/authorino/0.log"
Jul 17 22:14:47.319153 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:47.319117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rnhx4_c0858505-4ba4-4b94-a833-c64edc64120d/manager/0.log"
Jul 17 22:14:48.959257 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:48.959169    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/alertmanager/0.log"
Jul 17 22:14:48.986962 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:48.986927    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/config-reloader/0.log"
Jul 17 22:14:49.008543 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.008512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/kube-rbac-proxy-web/0.log"
Jul 17 22:14:49.034314 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.034254    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/kube-rbac-proxy/0.log"
Jul 17 22:14:49.054997 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.054952    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/kube-rbac-proxy-metric/0.log"
Jul 17 22:14:49.080998 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.080969    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/prom-label-proxy/0.log"
Jul 17 22:14:49.104577 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.104524    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_039b62ee-4e39-4548-98d3-27c2f572c5e9/init-config-reloader/0.log"
Jul 17 22:14:49.192134 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.192101    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-dqn8t_a1c8b25a-a008-4a40-ac34-b73c2a303d8d/kube-state-metrics/0.log"
Jul 17 22:14:49.215215 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.215138    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-dqn8t_a1c8b25a-a008-4a40-ac34-b73c2a303d8d/kube-rbac-proxy-main/0.log"
Jul 17 22:14:49.239681 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.239653    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-dqn8t_a1c8b25a-a008-4a40-ac34-b73c2a303d8d/kube-rbac-proxy-self/0.log"
Jul 17 22:14:49.272426 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.272392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9bd46598f-2gv7r_8fb59115-9acd-445e-896b-3309734bb12c/metrics-server/0.log"
Jul 17 22:14:49.299445 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.299416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-zxsvq_1d2d3546-0c68-4ddc-ba2d-fb671b6afdd0/monitoring-plugin/0.log"
Jul 17 22:14:49.330126 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.330097    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phgt_4e2fd377-e2f7-495e-9f42-2a43b38ef537/node-exporter/0.log"
Jul 17 22:14:49.351510 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.351476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phgt_4e2fd377-e2f7-495e-9f42-2a43b38ef537/kube-rbac-proxy/0.log"
Jul 17 22:14:49.385126 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.385097    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phgt_4e2fd377-e2f7-495e-9f42-2a43b38ef537/init-textfile/0.log"
Jul 17 22:14:49.575514 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.575478    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2cghq_c14d48b3-0ba4-43c6-a861-e04762a068d4/kube-rbac-proxy-main/0.log"
Jul 17 22:14:49.601723 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.601678    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2cghq_c14d48b3-0ba4-43c6-a861-e04762a068d4/kube-rbac-proxy-self/0.log"
Jul 17 22:14:49.623134 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.623106    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2cghq_c14d48b3-0ba4-43c6-a861-e04762a068d4/openshift-state-metrics/0.log"
Jul 17 22:14:49.661233 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.661202    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/prometheus/0.log"
Jul 17 22:14:49.681088 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.681056    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/config-reloader/0.log"
Jul 17 22:14:49.700880 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.700847    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/thanos-sidecar/0.log"
Jul 17 22:14:49.720359 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.720302    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/kube-rbac-proxy-web/0.log"
Jul 17 22:14:49.743688 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.743659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/kube-rbac-proxy/0.log"
Jul 17 22:14:49.763842 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.763815    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/kube-rbac-proxy-thanos/0.log"
Jul 17 22:14:49.783681 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.783650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d55a4ca-3115-4f9e-8f8f-21bd1c518e06/init-config-reloader/0.log"
Jul 17 22:14:49.811636 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.811592    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-6t28j_587344b6-5d4c-4120-beb6-882b280be642/prometheus-operator/0.log"
Jul 17 22:14:49.829693 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.829623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-6t28j_587344b6-5d4c-4120-beb6-882b280be642/kube-rbac-proxy/0.log"
Jul 17 22:14:49.863862 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.863825    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-68t6t_90b3a87c-68db-4f78-aadb-22f9e4a2309d/prometheus-operator-admission-webhook/0.log"
Jul 17 22:14:49.898999 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.898968    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fddd4c776-6g4zs_6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d/telemeter-client/0.log"
Jul 17 22:14:49.920744 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.920713    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fddd4c776-6g4zs_6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d/reload/0.log"
Jul 17 22:14:49.942663 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.942634    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fddd4c776-6g4zs_6aa4ae73-0f1c-40c8-afb7-884fa4ca6a2d/kube-rbac-proxy/0.log"
Jul 17 22:14:49.976759 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:49.976726    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/thanos-query/0.log"
Jul 17 22:14:50.001228 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:50.001188    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/kube-rbac-proxy-web/0.log"
Jul 17 22:14:50.026672 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:50.026625    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/kube-rbac-proxy/0.log"
Jul 17 22:14:50.047810 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:50.047754    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/prom-label-proxy/0.log"
Jul 17 22:14:50.067629 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:50.067596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/kube-rbac-proxy-rules/0.log"
Jul 17 22:14:50.087682 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:50.087609    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd96c9474-wsvzj_0c8b7a23-915d-4786-9c78-c26f39a23f34/kube-rbac-proxy-metrics/0.log"
Jul 17 22:14:51.163332 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.163298    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"]
Jul 17 22:14:51.169143 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.169112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.176665 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.173538    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjx6d\"/\"default-dockercfg-sgfdh\""
Jul 17 22:14:51.179620 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.179519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"]
Jul 17 22:14:51.336738 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.336690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-podres\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.336952 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.336779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-lib-modules\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.336952 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.336837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-proc\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.336952 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.336872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dkww\" (UniqueName: \"kubernetes.io/projected/d869a89a-255a-41e3-8daf-1df1b140cc12-kube-api-access-9dkww\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.336952 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.336908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-sys\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438293 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-lib-modules\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438293 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-proc\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dkww\" (UniqueName: \"kubernetes.io/projected/d869a89a-255a-41e3-8daf-1df1b140cc12-kube-api-access-9dkww\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-sys\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-proc\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-lib-modules\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-sys\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438527 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-podres\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.438879 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.438628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d869a89a-255a-41e3-8daf-1df1b140cc12-podres\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.446585 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.446559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dkww\" (UniqueName: \"kubernetes.io/projected/d869a89a-255a-41e3-8daf-1df1b140cc12-kube-api-access-9dkww\") pod \"perf-node-gather-daemonset-5ltcq\" (UID: \"d869a89a-255a-41e3-8daf-1df1b140cc12\") " pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.492265 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.492226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:51.677420 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:51.677179    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"]
Jul 17 22:14:51.686111 ip-10-0-128-177 kubenswrapper[2579]: W0717 22:14:51.686013    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd869a89a_255a_41e3_8daf_1df1b140cc12.slice/crio-060e4c56c58e0a4f2c20c1d0ba6f06896cf0bf8d36dc49537e4bb90591cfb5bf WatchSource:0}: Error finding container 060e4c56c58e0a4f2c20c1d0ba6f06896cf0bf8d36dc49537e4bb90591cfb5bf: Status 404 returned error can't find the container with id 060e4c56c58e0a4f2c20c1d0ba6f06896cf0bf8d36dc49537e4bb90591cfb5bf
Jul 17 22:14:52.269811 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:52.269740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq" event={"ID":"d869a89a-255a-41e3-8daf-1df1b140cc12","Type":"ContainerStarted","Data":"ef22764e8c36b4a29e67d421e9f192d39afc59c6aa5575595978623b3836cd33"}
Jul 17 22:14:52.270291 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:52.269836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq" event={"ID":"d869a89a-255a-41e3-8daf-1df1b140cc12","Type":"ContainerStarted","Data":"060e4c56c58e0a4f2c20c1d0ba6f06896cf0bf8d36dc49537e4bb90591cfb5bf"}
Jul 17 22:14:52.270376 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:52.270352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:52.307538 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:52.307511    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6889c48974-6vtjx_1a4a6035-b88b-4f60-986c-35a610ff3a6f/console/0.log"
Jul 17 22:14:52.349590 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:52.349557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-twcb4_39dceb1b-af79-4012-88df-26a9909d919f/download-server/0.log"
Jul 17 22:14:53.921357 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:53.921321    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnrph_1e79813f-3695-47f8-9872-63c0641b6377/dns/0.log"
Jul 17 22:14:53.945937 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:53.945907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnrph_1e79813f-3695-47f8-9872-63c0641b6377/kube-rbac-proxy/0.log"
Jul 17 22:14:54.075068 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:54.075036    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5v4pd_410283f8-7b47-4b6a-be61-313ff2eb27b6/dns-node-resolver/0.log"
Jul 17 22:14:54.702658 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:54.702624    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fhtcj_2418ed64-45c0-4ca5-8de9-7b6d080b338c/node-ca/0.log"
Jul 17 22:14:55.786393 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:55.786367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb8dc498-tghfg_fe852751-8f1c-40ea-ad62-d69b3e09bf3b/kube-auth-proxy/0.log"
Jul 17 22:14:55.900887 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:55.900859    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-r8nbn_33197c48-fcc9-404f-969d-20c8c9d2c5fe/payload-pre-processing/0.log"
Jul 17 22:14:55.933448 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:55.933421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-gjnzp_95d42920-d5b3-4726-a06c-15b23ed70ca4/payload-processing/0.log"
Jul 17 22:14:56.631962 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:56.631933    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9mrvr_3ce236c0-00df-45b1-b648-20447ba8fa0e/serve-healthcheck-canary/0.log"
Jul 17 22:14:57.340410 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:57.340379    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vqb2c_6f84e950-d6cc-48c3-961f-b587d4470007/kube-rbac-proxy/0.log"
Jul 17 22:14:57.359893 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:57.359866    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vqb2c_6f84e950-d6cc-48c3-961f-b587d4470007/exporter/0.log"
Jul 17 22:14:57.380603 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:57.380580    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vqb2c_6f84e950-d6cc-48c3-961f-b587d4470007/extractor/0.log"
Jul 17 22:14:58.288416 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:58.288365    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq"
Jul 17 22:14:58.305304 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:58.305220    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gjx6d/perf-node-gather-daemonset-5ltcq" podStartSLOduration=7.3051997140000005 podStartE2EDuration="7.305199714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:14:52.286219547 +0000 UTC m=+3459.067479275" watchObservedRunningTime="2026-07-17 22:14:58.305199714 +0000 UTC m=+3465.086459445"
Jul 17 22:14:59.769646 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:59.769611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bdd5689cb-46fq2_0e32303f-f47a-461e-9c11-2f27f3da8287/manager/0.log"
Jul 17 22:14:59.957445 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:59.957406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6dbd9688-tjpp6_1e2b6831-9412-41bd-a8d5-52c5efe397ea/manager/0.log"
Jul 17 22:14:59.977864 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:14:59.977831    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6dbd9688-tjpp6_1e2b6831-9412-41bd-a8d5-52c5efe397ea/copy-manifests/0.log"
Jul 17 22:15:01.584830 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:01.584789    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76f7bc5b6f-7l8wh_77a566c0-7d93-4097-9d0b-1197554f5b08/manager/0.log"
Jul 17 22:15:01.630165 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:01.630130    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-k4cwj_af0802d6-71e5-4253-8778-f1fa7766c140/openshift-lws-operator/0.log"
Jul 17 22:15:02.398137 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:02.398071    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb8dc498-tghfg_fe852751-8f1c-40ea-ad62-d69b3e09bf3b/kube-auth-proxy/0.log"
Jul 17 22:15:02.493792 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:02.493463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-r8nbn_33197c48-fcc9-404f-969d-20c8c9d2c5fe/payload-pre-processing/0.log"
Jul 17 22:15:02.517530 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:02.517448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-gjnzp_95d42920-d5b3-4726-a06c-15b23ed70ca4/payload-processing/0.log"
Jul 17 22:15:03.784657 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:03.784628    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb8dc498-tghfg_fe852751-8f1c-40ea-ad62-d69b3e09bf3b/kube-auth-proxy/0.log"
Jul 17 22:15:03.883533 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:03.883485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-r8nbn_33197c48-fcc9-404f-969d-20c8c9d2c5fe/payload-pre-processing/0.log"
Jul 17 22:15:03.909076 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:03.909051    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-gjnzp_95d42920-d5b3-4726-a06c-15b23ed70ca4/payload-processing/0.log"
Jul 17 22:15:08.005776 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.005746    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/kube-multus-additional-cni-plugins/0.log"
Jul 17 22:15:08.028427 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.028396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/egress-router-binary-copy/0.log"
Jul 17 22:15:08.047009 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.046978    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/cni-plugins/0.log"
Jul 17 22:15:08.066178 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.066146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/bond-cni-plugin/0.log"
Jul 17 22:15:08.085289 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.085263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/routeoverride-cni/0.log"
Jul 17 22:15:08.105199 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.105170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/whereabouts-cni-bincopy/0.log"
Jul 17 22:15:08.125577 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.125553    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bbjp_7e3b4b11-9d18-46c8-b054-f67cb80b7be7/whereabouts-cni/0.log"
Jul 17 22:15:08.467516 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.467484    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h2xl8_286f2d8d-5444-471d-9b09-a3e44578abda/kube-multus/0.log"
Jul 17 22:15:08.580277 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.580202    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-st68l_a150c5d0-edb0-4e35-86e6-24ecfbcf3582/network-metrics-daemon/0.log"
Jul 17 22:15:08.596754 ip-10-0-128-177 kubenswrapper[2579]: I0717 22:15:08.596724    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-st68l_a150c5d0-edb0-4e35-86e6-24ecfbcf3582/kube-rbac-proxy/0.log"